00000001:02000400:3.0F:1786400649.071725:0:2961:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg408-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1786400670.078457:0:3182:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg408-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1786400671.828163:0:3246:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 699 MB/s 00000001:01000000:2.0:1786400672.078211:0:3246:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1103 MB/s 00000001:01000000:3.0:1786400672.328417:0:3246:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 7347 MB/s 00000020:02000000:2.0:1786400673.153912:0:3275:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_108_g0ecde8c 00000400:02000000:0.0:1786400673.888282:0:3290:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.204.108@tcp [8/256/0/180] 00008000:02000000:0.0:1786400677.290807:0:3439:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0F:1786400730.847885:0:5245:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg408-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1786400740.187409:0:5769:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1786400740.187417:0:5769:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1786400740.187579:0:5769:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000c5e820e0 00000080:02000400:1.0:1786400740.187592:0:5769:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1786400740.197041:0:5769:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1786400740.197063:0:5769:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1786400740.197141:0:5769:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000da196871) 00000020:00000080:1.0:1786400740.197163:0:5769:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1786400740.217701:0:5769:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1786400740.218625:0:5769:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1786400740.258625:0:5769:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1786400740.258662:0:5769:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1786400740.258679:0:5769:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1786400740.258724:0:5769:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1786400740.258744:0:5769:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1786400740.261010:0:5769:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1786400740.261019:0:5769:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1786400740.261029:0:5769:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5ccaaf4f3cb1d582 00000020:01000004:1.0:1786400740.261037:0:5769:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1786400740.261042:0:5769:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1786400740.261057:0:5769:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c5e820e0 from MGS 00000020:01000004:1.0:1786400740.261061:0:5769:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1786400740.261072:0:5769:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000007be10cdd) 00000020:00000080:1.0:1786400740.261082:0:5769:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1786400740.262493:0:5769:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c5e820e0 from MGS, refs=2 00080000:01000000:2.0:1786400740.262502:0:5769:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1786400740.262510:0:5769:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5ccaaf4f3cb1d590 00000100:00100000:2.0:1786400740.262636:0:5769:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1786400740.262753:0:5769:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1786400740.262759:0:5769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1786400740.266409:0:5769:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1786400740.266422:0:5769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1786400740.267291:0:5769:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786400740.267460:0:5769:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1786400740.267464:0:5769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1786400740.268057:0:5769:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1786400740.268064:0:5769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1786400740.269473:0:5769:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1786400740.269482:0:5769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1786400740.270355:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400740.270360:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400740.270362:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400740.270608:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400740.270611:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400740.270612:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400740.271585:0:5769:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1786400740.273397:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1786400740.521256:0:5769:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4359 MB/s 00000001:01000000:2.0:1786400740.771270:0:5769:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 5931 MB/s 00000001:01000000:2.0:1786400741.021267:0:5769:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1111 MB/s 00000001:01000000:1.0:1786400741.271358:0:5769:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1151 MB/s 00080000:10000000:1.0:1786400741.279534:0:5769:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1786400741.288775:0:5769:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1786400741.288791:0:5769:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1786400741.288793:0:5769:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1786400741.289528:0:5779:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1786400741.289599:0:5769:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1786400741.289668:0:5769:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1786400741.289872:0:5769:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1786400741.289913:0:5769:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1786400741.290761:0:5769:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1786400741.290919:0:5769:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1786400741.290932:0:5769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1786400741.292991:0:5769:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1786400741.293003:0:5769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1786400741.294750:0:5769:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1786400741.294764:0:5769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00010000:00010000:2.0:1786400741.295508:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1786400741.297074:0:5784:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1786400741.297117:0:5769:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1786400741.297448:0:5769:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.108@tcp' 00000020:01000004:0.0:1786400741.297451:0:5769:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1786400741.297630:0:5769:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.108@tcp (typ=mgc) 00000020:00000080:0.0:1786400741.297659:0:5769:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.108@tcp (0000000012bd23aa) 00000020:00000080:0.0:1786400741.297679:0:5769:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1786400741.297814:0:5769:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000062040e95@MGC192.168.204.108@tcp: add connection 192.168.204.108@tcp at head 00010000:00010000:0.0:1786400741.297958:0:5769:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.108@tcp-0 is initialized 00000040:01000000:0.0:1786400741.297964:0:5769:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.108@tcp ctxt 1 is initialized 10000000:01000000:0.0:1786400741.298554:0:5785:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1786400741.298585:0:5769:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.108@tcp (uuid 97b0324f-e214-4822-8711-e150ddac2a7e) 00000020:00000080:0.0:1786400741.298600:0:5769:0:(genops.c:1406:class_connect()) connect: client 97b0324f-e214-4822-8711-e150ddac2a7e, cookie 0x5ccaaf4f3cb1d59e 00000100:00080000:0.0:1786400741.298609:0:5769:0:(import.c:510:import_select_connection()) MGC192.168.204.108@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1786400741.298614:0:5769:0:(import.c:624:import_select_connection()) MGC192.168.204.108@tcp: import 0000000062040e95 using connection 192.168.204.108@tcp/0@lo 00000100:00100000:0.0:1786400741.298668:0:5769:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003775ca4b x1873176872091776/t0(0) o250->MGC192.168.204.108@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786400741.298695:0:5769:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 97b0324f-e214-4822-8711-e150ddac2a7e->MGS 00000020:01000004:0.0:1786400741.298715:0:5769:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1786400741.298720:0:5769:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1786400741.298730:0:5769:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000bb175a4d) 00000020:00000080:0.0:1786400741.298739:0:5769:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1786400741.298756:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003775ca4b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:97b0324f-e214-4822-8711-e150ddac2a7e:3305:1873176872091776:0@lo:250: 00000100:00100000:1.0:1786400741.298846:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400741.298913:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872091776 00000100:00100000:1.0:1786400741.298920:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872091776 00000100:00100000:1.0:1786400741.298947:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786400741.298954:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004bd21a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3305:x1873176872091776:12345-0@lo:250: 00010000:00080000:1.0:1786400741.298976:0:5780:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 97b0324f-e214-4822-8711-e150ddac2a7e@0@lo t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:1.0:1786400741.298998:0:5780:0:(genops.c:1406:class_connect()) connect: client 97b0324f-e214-4822-8711-e150ddac2a7e, cookie 0x5ccaaf4f3cb1d5ac 00000100:00080000:1.0:1786400741.299155:0:5780:0:(import.c:65:import_set_state_nolock()) 00000000d50d1446 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786400741.299203:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004bd21a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+5:3305:x1873176872091776:12345-0@lo:250: Request processed in 249us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400741.299211:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786400741.299255:0:3305:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.108@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1786400741.299264:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.108@tcp: connect to target with instance 0 00000100:00080000:1.0:1786400741.299271:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.108@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1786400741.299275:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1786400741.299278:0:3305:0:(import.c:65:import_set_state_nolock()) 0000000062040e95 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1786400741.299281:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1786400741.299284:0:3305:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1786400741.299289:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003775ca4b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:97b0324f-e214-4822-8711-e150ddac2a7e:3305:1873176872091776:0@lo:250: 00000100:00100000:0.0:1786400741.325490:0:5769:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1786400741.325957:0:5769:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1786400741.325965:0:5769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1786400741.328625:0:5769:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1786400741.328637:0:5769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1786400741.329423:0:5769:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1786400741.329432:0:5769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1786400741.335969:0:5769:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1786400741.336211:0:5769:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1786400741.336218:0:5769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1786400741.341271:0:5769:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1786400741.341288:0:5769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1786400741.393856:0:5769:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786400741.394274:0:5769:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1786400741.394282:0:5769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1786400741.395466:0:5769:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1786400741.395475:0:5769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1786400741.397286:0:5769:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786400741.397449:0:5769:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1786400741.397455:0:5769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1786400741.398450:0:5769:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1786400741.398460:0:5769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1786400741.399358:0:5769:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786400741.399513:0:5769:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1786400741.399518:0:5769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1786400741.400443:0:5769:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1786400741.400452:0:5769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1786400741.401993:0:5769:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786400741.402761:0:5769:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1786400741.402768:0:5769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1786400741.403431:0:5769:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1786400741.403439:0:5769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1786400741.439939:0:5769:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786400741.440243:0:5769:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1786400741.440251:0:5769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1786400741.443447:0:5769:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1786400741.443462:0:5769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1786400741.447579:0:5769:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1786400741.447596:0:5769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1786400741.449253:0:5769:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1786400741.449278:0:5769:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1786400741.449284:0:5769:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.108@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1786400741.449505:0:5769:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.108@tcp ctxt 0 is initialized 00000020:01000004:3.0:1786400741.449541:0:5769:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.108@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1786400741.449545:0:5769:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1786400741.449547:0:5769:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1786400741.449548:0:5769:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786400741.449549:0:5769:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786400741.449550:0:5769:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786400741.449555:0:5769:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786400741.449556:0:5769:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1786400741.449557:0:5769:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1786400741.449558:0:5769:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1786400741.449559:0:5769:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1786400741.449560:0:5769:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786400741.449562:0:5769:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1786400741.449564:0:5769:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1786400741.449566:0:5769:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1786400741.449566:0:5769:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1786400741.449567:0:5769:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786400741.449568:0:5769:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786400741.449569:0:5769:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786400741.449570:0:5769:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786400741.449571:0:5769:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1786400741.449572:0:5769:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1786400741.449573:0:5769:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1786400741.449574:0:5769:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1786400741.449575:0:5769:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786400741.449575:0:5769:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1786400741.449833:0:5769:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1786400741.449858:0:5769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dfbdfd6e pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:5769:1873176872091904:0@lo:253: 00000100:00100000:3.0:1786400741.449927:0:5769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400741.450038:0:5769:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a2263ab2 going to sleep for 11 seconds 00000100:00100000:1.0:1786400741.450243:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872091904 00000100:00100000:1.0:1786400741.450259:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872091904 00000100:00100000:1.0:1786400741.450346:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786400741.450354:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000f978672 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+5:5769:x1873176872091904:12345-0@lo:253: 20000000:01000000:1.0:1786400741.450549:0:5783:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1786400741.450552:0:5783:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1786400741.451284:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1786400741.451443:0:5783:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1786400741.451795:0:5783:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1786400741.454083:0:5805:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1786400741.454769:0:5783:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1786400741.454775:0:5783:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1786400741.454782:0:5783:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1786400741.454785:0:5783:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1786400741.454800:0:5783:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1786400741.455048:0:5783:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786400741.455315:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1786400741.455330:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1786400741.455496:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1786400741.455548:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1786400741.455585:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1786400741.455701:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1786400741.455710:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1786400741.455760:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1786400741.455768:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1786400741.455815:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1786400741.455823:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1786400741.455852:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1786400741.455905:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1786400741.455936:0:5783:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1786400741.455942:0:5783:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1786400741.455956:0:5783:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786400741.456590:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1786400741.456603:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1786400741.456700:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1786400741.456736:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1786400741.456785:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1786400741.456799:0:5783:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1786400741.456881:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1786400741.456891:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1786400741.456935:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1786400741.456972:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1786400741.457008:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1786400741.457019:0:5783:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1786400741.457255:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1786400741.457268:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1786400741.457303:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1786400741.457340:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1786400741.457930:0:5783:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1786400741.457984:0:5783:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1786400741.457992:0:5783:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1786400741.459618:0:5806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1786400741.460664:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1786400741.460694:0:5783:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.108@tcp for mdt 20000000:01000000:3.0:1786400741.460708:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.108@tcp (null) (null) (null) 00000040:00080000:3.0:1786400741.460749:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1786400741.460757:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1786400741.460808:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1786400741.460817:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.108@tcp (null) (null) 00000040:00080000:3.0:1786400741.460861:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1786400741.460872:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1786400741.460904:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1786400741.460939:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1786400741.461009:0:5783:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1786400741.461012:0:5783:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1786400741.461019:0:5783:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1786400741.464189:0:5783:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1786400741.467546:0:5807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:1.0:1786400741.468408:0:5783:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1786400741.487630:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1786400741.487681:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:1.0:1786400741.487785:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:1.0:1786400741.487806:0:5783:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1786400741.487809:0:5783:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1786400741.487814:0:5783:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1786400741.488638:0:5783:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1786400741.488642:0:5783:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1786400741.488684:0:5783:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1786400741.488687:0:5783:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1786400741.489761:0:5808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:0.0:1786400741.490503:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:0.0:1786400741.490558:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:0.0:1786400741.490633:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:0.0:1786400741.490647:0:5783:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1786400741.490650:0:5783:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1786400741.491349:0:5809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1786400741.491619:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1786400741.491660:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1786400741.491703:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1786400741.491718:0:5783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1786400741.491720:0:5783:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:0.0:1786400741.491727:0:5783:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1786400741.491748:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000acf145ae/0x5ccaaf4f3cb1d5b3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400741.491766:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000acf145ae/0x5ccaaf4f3cb1d5b3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400741.491775:0:5783:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000acf145ae/0x5ccaaf4f3cb1d5b3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400741.491780:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000acf145ae/0x5ccaaf4f3cb1d5b3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400741.491798:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000acf145ae/0x5ccaaf4f3cb1d5b3 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400741.491804:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000acf145ae/0x5ccaaf4f3cb1d5b3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400741.491809:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000acf145ae already unused, calling callback (000000001cb7fc51) 00010000:00010000:0.0:1786400741.491812:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000acf145ae/0x5ccaaf4f3cb1d5b3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400741.491819:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000acf145ae/0x5ccaaf4f3cb1d5b3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400741.491831:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000acf145ae/0x5ccaaf4f3cb1d5b3 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400741.491838:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000acf145ae/0x5ccaaf4f3cb1d5b3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400741.491844:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000acf145ae/0x5ccaaf4f3cb1d5b3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1786400741.491862:0:5783:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1786400741.785460:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000f978672 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+5:5769:x1873176872091904:12345-0@lo:253: Request processed in 335099us (335525us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400741.785481:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1786400741.785695:0:5769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dfbdfd6e pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:5769:1873176872091904:0@lo:253: 10000000:01000000:3.0:1786400741.785711:0:5769:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1786400741.785715:0:5769:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1786400741.785717:0:5769:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1786400741.785718:0:5769:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786400741.785720:0:5769:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1786400741.785721:0:5769:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786400741.785723:0:5769:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786400741.785724:0:5769:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1786400741.785725:0:5769:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1786400741.785727:0:5769:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1786400741.785728:0:5769:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786400741.785730:0:5769:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1786400741.785966:0:5769:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c5e820e0 from lustre-MDT0000 10000000:01000000:3.0:1786400741.785992:0:5769:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1786400741.786007:0:5769:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1786400741.786012:0:5769:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9d6fc523cd40 10000000:01000000:3.0:1786400741.786025:0:5769:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1786400741.786034:0:5769:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9d6fc523cd40 from 1 10000000:01000000:3.0:1786400741.786037:0:5769:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1786400741.786072:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: 00000000e013e697/0x5ccaaf4f3cb1d5ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400741.786083:0:5769:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: 00000000e013e697/0x5ccaaf4f3cb1d5ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400741.786118:0:5769:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: 00000000e013e697/0x5ccaaf4f3cb1d5ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400741.786276:0:5769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dfbdfd6e pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:5769:1873176872092032:0@lo:101: 00000100:00100000:3.0:1786400741.786316:0:5769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400741.786967:0:5769:0:(client.c:2702:ptlrpc_set_wait()) set 0000000066cb9a5c going to sleep for 11 seconds 00000100:00100000:1.0:1786400741.787103:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872092032 00000100:00100000:1.0:1786400741.787112:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872092032 00000100:00100000:1.0:1786400741.787282:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1786400741.787291:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e002e92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+5:5769:x1873176872092032:12345-0@lo:101: 00010000:00010000:1.0:1786400741.787305:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400741.787322:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005a0e177e/0x5ccaaf4f3cb1d5c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d5ba expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400741.787346:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005a0e177e/0x5ccaaf4f3cb1d5c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d5ba expref: 6 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400741.787356:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005a0e177e/0x5ccaaf4f3cb1d5c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d5ba expref: 6 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400741.787514:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005a0e177e, rc 0) 00000100:00100000:1.0:1786400741.787571:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e002e92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+6:5769:x1873176872092032:12345-0@lo:101: Request processed in 281us (1255us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400741.787589:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1786400741.787801:0:5769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dfbdfd6e pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:5769:1873176872092032:0@lo:101: 00010000:00010000:3.0:1786400741.787814:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: 00000000e013e697/0x5ccaaf4f3cb1d5ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d5c1 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400741.787822:0:5769:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: 00000000e013e697/0x5ccaaf4f3cb1d5ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d5c1 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400741.787880:0:5769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dfbdfd6e pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:5769:1873176872092160:0@lo:501: 00000100:00100000:3.0:1786400741.787909:0:5769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400741.788459:0:5769:0:(client.c:2702:ptlrpc_set_wait()) set 0000000066cb9a5c going to sleep for 11 seconds 00000100:00100000:2.0:1786400741.788609:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872092160 00000100:00100000:2.0:1786400741.788617:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872092160 00000100:00100000:2.0:1786400741.788648:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1786400741.788655:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070c7c666 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+6:5769:x1873176872092160:12345-0@lo:501: 00000100:00100000:2.0:1786400741.789307:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070c7c666 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+6:5769:x1873176872092160:12345-0@lo:501: Request processed in 651us (1396us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786400741.789316:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1786400741.790177:0:5769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dfbdfd6e pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:5769:1873176872092160:0@lo:501: 10000000:01000000:3.0:1786400741.790222:0:5769:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1786400741.790250:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: 00000000e013e697/0x5ccaaf4f3cb1d5ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d5c1 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400741.790260:0:5769:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: 00000000e013e697/0x5ccaaf4f3cb1d5ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d5c1 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400741.790270:0:5769:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d6fc307d800 10000000:01000000:3.0:1786400741.790275:0:5769:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1786400741.790279:0:5769:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9d6fc307d800 10000000:01000000:3.0:1786400741.790282:0:5769:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1786400741.790284:0:5769:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9d6fc307d800 from 1 10000000:01000000:3.0:1786400741.790287:0:5769:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1786400741.790318:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: 00000000b1455358/0x5ccaaf4f3cb1d5c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400741.790325:0:5769:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: 00000000b1455358/0x5ccaaf4f3cb1d5c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400741.790334:0:5769:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: 00000000b1455358/0x5ccaaf4f3cb1d5c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400741.790349:0:5769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dfbdfd6e pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:5769:1873176872092288:0@lo:101: 00000100:00100000:3.0:1786400741.790689:0:5769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400741.790721:0:5769:0:(client.c:2702:ptlrpc_set_wait()) set 0000000066cb9a5c going to sleep for 11 seconds 00000100:00100000:2.0:1786400741.791183:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872092288 00000100:00100000:2.0:1786400741.791193:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872092288 00000100:00100000:2.0:1786400741.791240:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1786400741.791249:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c061e390 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+6:5769:x1873176872092288:12345-0@lo:101: 00010000:00010000:2.0:1786400741.791263:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400741.791281:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005a1b769b/0x5ccaaf4f3cb1d5cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d5c8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400741.791303:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005a1b769b/0x5ccaaf4f3cb1d5cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d5c8 expref: 7 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400741.791313:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005a1b769b/0x5ccaaf4f3cb1d5cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d5c8 expref: 7 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400741.791320:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005a1b769b, rc 0) 00000100:00100000:2.0:1786400741.791357:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c061e390 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+7:5769:x1873176872092288:12345-0@lo:101: Request processed in 109us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400741.791825:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1786400741.792041:0:5769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dfbdfd6e pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:5769:1873176872092288:0@lo:101: 00010000:00010000:3.0:1786400741.792057:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: 00000000b1455358/0x5ccaaf4f3cb1d5c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d5cf expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400741.792067:0:5769:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: 00000000b1455358/0x5ccaaf4f3cb1d5c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d5cf expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400741.792126:0:5769:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1786400741.792136:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: 00000000b1455358/0x5ccaaf4f3cb1d5c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d5cf expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400741.792143:0:5769:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: 00000000b1455358/0x5ccaaf4f3cb1d5c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d5cf expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400741.792151:0:5769:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1786400741.792155:0:5769:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1786400741.792162:0:5769:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9d6fc307d800 10000000:01000000:3.0:1786400741.792164:0:5769:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1786400741.792167:0:5769:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1786400741.792170:0:5769:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1786400741.792192:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: 000000002e776e0f/0x5ccaaf4f3cb1d5d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400741.792199:0:5769:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: 000000002e776e0f/0x5ccaaf4f3cb1d5d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400741.792206:0:5769:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: 000000002e776e0f/0x5ccaaf4f3cb1d5d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400741.792219:0:5769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dfbdfd6e pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:5769:1873176872092416:0@lo:101: 00000100:00100000:3.0:1786400741.792253:0:5769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400741.792277:0:5769:0:(client.c:2702:ptlrpc_set_wait()) set 0000000066cb9a5c going to sleep for 11 seconds 00000100:00100000:2.0:1786400741.792900:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872092416 00000100:00100000:2.0:1786400741.792907:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872092416 00000100:00100000:2.0:1786400741.792950:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1786400741.792958:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc8e866d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+7:5769:x1873176872092416:12345-0@lo:101: 00010000:00010000:2.0:1786400741.792970:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400741.792982:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d88052ad/0x5ccaaf4f3cb1d5dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d5d6 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400741.792999:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d88052ad/0x5ccaaf4f3cb1d5dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d5d6 expref: 8 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400741.793007:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d88052ad/0x5ccaaf4f3cb1d5dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d5d6 expref: 8 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400741.793014:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d88052ad, rc 0) 00000100:00100000:2.0:1786400741.793443:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc8e866d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+8:5769:x1873176872092416:12345-0@lo:101: Request processed in 484us (1188us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400741.793450:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1786400741.793543:0:5769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dfbdfd6e pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:5769:1873176872092416:0@lo:101: 00010000:00010000:3.0:1786400741.793556:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: 000000002e776e0f/0x5ccaaf4f3cb1d5d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d5dd expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400741.793580:0:5769:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: 000000002e776e0f/0x5ccaaf4f3cb1d5d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d5dd expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400741.793641:0:5769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dfbdfd6e pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:5769:1873176872092544:0@lo:501: 00000100:00100000:3.0:1786400741.793670:0:5769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400741.793700:0:5769:0:(client.c:2702:ptlrpc_set_wait()) set 0000000066cb9a5c going to sleep for 11 seconds 00000100:00100000:1.0:1786400741.794500:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872092544 00000100:00100000:1.0:1786400741.794509:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872092544 00000100:00100000:1.0:1786400741.794560:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1786400741.794567:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6ce6913 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+8:5769:x1873176872092544:12345-0@lo:501: 00000100:00100000:1.0:1786400741.794890:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6ce6913 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+9:5769:x1873176872092544:12345-0@lo:501: Request processed in 323us (1220us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400741.794898:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1786400741.795191:0:5769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dfbdfd6e pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:5769:1873176872092544:0@lo:501: 00000100:00100000:3.0:1786400741.795229:0:5769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dfbdfd6e pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:5769:1873176872092672:0@lo:503: 00000100:00100000:3.0:1786400741.795268:0:5769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400741.795300:0:5769:0:(client.c:2702:ptlrpc_set_wait()) set 0000000066cb9a5c going to sleep for 11 seconds 00000100:00100000:1.0:1786400741.795822:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872092672 00000100:00100000:1.0:1786400741.795828:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872092672 00000100:00100000:1.0:1786400741.795861:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1786400741.795866:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab95c408 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+9:5769:x1873176872092672:12345-0@lo:503: 00000100:00100000:1.0:1786400741.796033:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab95c408 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+9:5769:x1873176872092672:12345-0@lo:503: Request processed in 167us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400741.796041:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1786400741.796477:0:5769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dfbdfd6e pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:5769:1873176872092672:0@lo:503: 00000100:00100000:3.0:1786400741.797444:0:5811:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dfbdfd6e pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:5811:1873176872092800:0@lo:502: 00000100:00100000:3.0:1786400741.797507:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400741.797548:0:5811:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d17638dc going to sleep for 11 seconds 00000100:00100000:1.0:1786400741.797908:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872092800 00000100:00100000:1.0:1786400741.797915:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872092800 00000100:00100000:1.0:1786400741.798228:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1786400741.798239:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000169d60b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+9:5811:x1873176872092800:12345-0@lo:502: 00000100:00100000:1.0:1786400741.798954:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000169d60b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+9:5811:x1873176872092800:12345-0@lo:502: Request processed in 717us (1447us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400741.798964:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1786400741.799232:0:5811:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dfbdfd6e pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:5811:1873176872092800:0@lo:502: 00000020:01000000:3.0:1786400741.799262:0:5811:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786400741.799273:0:5811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786400741.799276:0:5811:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1786400741.799280:0:5811:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1786400741.799283:0:5811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1786400741.799304:0:5811:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000001e957dfc) 00000020:00000080:3.0:1786400741.799322:0:5811:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1786400741.799328:0:5811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1786400741.799878:0:5811:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:3.0:1786400741.799887:0:5811:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5ccaaf4f3cb1d5eb 00000020:00000080:3.0:1786400741.800402:0:5811:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1786400741.800417:0:5811:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786400741.800422:0:5811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786400741.800424:0:5811:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1786400741.800427:0:5811:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786400741.800431:0:5811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786400741.800432:0:5811:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1786400741.800436:0:5811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1786400741.800444:0:5811:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000062569af9) 00000020:00000080:3.0:1786400741.800456:0:5811:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1786400741.800460:0:5811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1786400741.800462:0:5811:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1786400741.800465:0:5811:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1786400741.800471:0:5811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1786400741.800521:0:5811:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c5e820e0 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1786400741.800532:0:5811:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000096f09cf8) 00000020:00000080:3.0:1786400741.800539:0:5811:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1786400741.800587:0:5811:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1786400741.800593:0:5811:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5ccaaf4f3cb1d600 00000020:00000080:3.0:1786400741.800684:0:5811:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1786400741.800691:0:5811:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1786400741.800695:0:5811:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5ccaaf4f3cb1d607 00080000:01000000:3.0:1786400741.800700:0:5811:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:3.0:1786400741.800703:0:5811:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5ccaaf4f3cb1d60e 00080000:10000000:3.0:1786400741.801182:0:5811:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1786400741.801367:0:5811:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1786400741.811724:0:5811:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1786400741.938127:0:5811:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1786400741.938712:0:5811:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1786400741.942603:0:5811:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1786400741.942907:0:5811:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1786400741.973407:0:5811:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000007eb30583) 00000020:00000080:0.0:1786400741.973429:0:5811:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1786400741.973502:0:5811:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:0.0:1786400741.973509:0:5811:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5ccaaf4f3cb1d61c 00000020:00000080:2.0:1786400741.974162:0:5811:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1786400741.976675:0:5811:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1786400742.043856:0:5811:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1786400742.075726:0:5811:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1786400742.099679:0:5811:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1786400742.132310:0:5811:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1786400742.154219:0:5811:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1786400742.182937:0:5811:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5ccaaf4f3cb1d623 00000020:00000080:2.0:1786400742.183325:0:5811:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1786400742.183337:0:5811:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786400742.183344:0:5811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786400742.183346:0:5811:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1786400742.183349:0:5811:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786400742.183355:0:5811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786400742.183356:0:5811:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1786400742.183360:0:5811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1786400742.183399:0:5811:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1786400742.183420:0:5811:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786400742.183423:0:5811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786400742.183424:0:5811:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1786400742.183426:0:5811:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786400742.183429:0:5811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786400742.183430:0:5811:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1786400742.183433:0:5811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1786400742.183434:0:5811:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1786400742.183488:0:5811:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d0af4d27 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:5811:1873176872092928:0@lo:502: 00000100:00100000:2.0:1786400742.183564:0:5811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400742.183606:0:5811:0:(client.c:2702:ptlrpc_set_wait()) set 0000000091a28d43 going to sleep for 11 seconds 00000100:00100000:2.0:1786400742.183631:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872092928 00000100:00100000:2.0:1786400742.183638:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872092928 00000100:00100000:2.0:1786400742.183677:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1786400742.183688:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9ace0a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+9:5811:x1873176872092928:12345-0@lo:502: 00000100:00100000:2.0:1786400742.184152:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9ace0a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+9:5811:x1873176872092928:12345-0@lo:502: Request processed in 467us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400742.184162:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1786400742.184212:0:5811:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d0af4d27 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:5811:1873176872092928:0@lo:502: 00000020:01000000:2.0:1786400742.184238:0:5811:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786400742.184247:0:5811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786400742.184249:0:5811:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:2.0:1786400742.184252:0:5811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1786400742.184533:0:5769:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1786400742.184552:0:5769:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1786400742.184571:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: 000000002e776e0f/0x5ccaaf4f3cb1d5d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d5dd expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400742.184594:0:5769:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: 000000002e776e0f/0x5ccaaf4f3cb1d5d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d5dd expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400742.184602:0:5769:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9d6fc307d800 from 1 10000000:01000000:1.0:1786400742.184605:0:5769:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1786400742.184640:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: 000000001253adbc/0x5ccaaf4f3cb1d62a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400742.184648:0:5769:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: 000000001253adbc/0x5ccaaf4f3cb1d62a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400742.184656:0:5769:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: 000000001253adbc/0x5ccaaf4f3cb1d62a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400742.184669:0:5769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c12d6f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:5769:1873176872093056:0@lo:101: 00000100:00100000:1.0:1786400742.184699:0:5769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400742.184726:0:5769:0:(client.c:2702:ptlrpc_set_wait()) set 000000000f6c9176 going to sleep for 11 seconds 00000100:00100000:3.0:1786400742.184852:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872093056 00000100:00100000:3.0:1786400742.184858:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872093056 00000100:00100000:3.0:1786400742.184894:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1786400742.184902:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086b2672e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+9:5769:x1873176872093056:12345-0@lo:101: 00010000:00010000:3.0:1786400742.184918:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400742.184931:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c52dcdc7/0x5ccaaf4f3cb1d631 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d62a expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400742.184952:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c52dcdc7/0x5ccaaf4f3cb1d631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d62a expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400742.184961:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c52dcdc7/0x5ccaaf4f3cb1d631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d62a expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400742.184970:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c52dcdc7, rc 0) 00000100:00100000:3.0:1786400742.184999:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086b2672e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+10:5769:x1873176872093056:12345-0@lo:101: Request processed in 99us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400742.185006:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1786400742.185121:0:5769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c12d6f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:5769:1873176872093056:0@lo:101: 00010000:00010000:1.0:1786400742.185133:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: 000000001253adbc/0x5ccaaf4f3cb1d62a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d631 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400742.185141:0:5769:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: 000000001253adbc/0x5ccaaf4f3cb1d62a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d631 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400742.185677:0:5769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c12d6f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:5769:1873176872093184:0@lo:256: 00000100:00100000:1.0:1786400742.185714:0:5769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400742.185837:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872093184 00000100:00100000:3.0:1786400742.185842:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872093184 00000100:00100000:3.0:1786400742.185869:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1786400742.185876:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bbbddce8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+10:5769:x1873176872093184:12345-0@lo:256: 20000000:01000000:3.0:1786400742.185890:0:5781:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1786400742.185895:0:5781:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1786400742.185951:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bbbddce8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+10:5769:x1873176872093184:12345-0@lo:256: Request processed in 75us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400742.185957:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1786400742.186027:0:5769:0:(client.c:2702:ptlrpc_set_wait()) set 000000000f6c9176 going to sleep for 11 seconds 00000100:00100000:1.0:1786400742.186048:0:5769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c12d6f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:5769:1873176872093184:0@lo:256: 10000000:01000000:1.0:1786400742.186851:0:5769:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1786400742.186904:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: 000000001253adbc/0x5ccaaf4f3cb1d62a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d631 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400742.186915:0:5769:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: 000000001253adbc/0x5ccaaf4f3cb1d62a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d631 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400742.186923:0:5769:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6fc307d800 from 1 10000000:01000000:1.0:1786400742.186926:0:5769:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1786400742.186951:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: 00000000945ba3c4/0x5ccaaf4f3cb1d638 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400742.186958:0:5769:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: 00000000945ba3c4/0x5ccaaf4f3cb1d638 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400742.186965:0:5769:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: 00000000945ba3c4/0x5ccaaf4f3cb1d638 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400742.186981:0:5769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c12d6f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:5769:1873176872093312:0@lo:101: 00000100:00100000:1.0:1786400742.187031:0:5769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400742.187060:0:5769:0:(client.c:2702:ptlrpc_set_wait()) set 000000000f6c9176 going to sleep for 11 seconds 00000100:00100000:3.0:1786400742.187142:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872093312 00000100:00100000:3.0:1786400742.187148:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872093312 00000100:00100000:3.0:1786400742.187189:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1786400742.187197:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006fdffdbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+10:5769:x1873176872093312:12345-0@lo:101: 00010000:00010000:3.0:1786400742.187206:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400742.187225:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c76c5528/0x5ccaaf4f3cb1d63f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d638 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400742.187243:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c76c5528/0x5ccaaf4f3cb1d63f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d638 expref: 11 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400742.187252:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c76c5528/0x5ccaaf4f3cb1d63f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d638 expref: 11 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400742.187260:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c76c5528, rc 0) 00000100:00100000:3.0:1786400742.187290:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006fdffdbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+11:5769:x1873176872093312:12345-0@lo:101: Request processed in 95us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400742.187297:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1786400742.187492:0:5769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c12d6f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:5769:1873176872093312:0@lo:101: 00010000:00010000:1.0:1786400742.187504:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: 00000000945ba3c4/0x5ccaaf4f3cb1d638 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d63f expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400742.187511:0:5769:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: 00000000945ba3c4/0x5ccaaf4f3cb1d638 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d63f expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400742.187564:0:5769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c12d6f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:5769:1873176872093440:0@lo:501: 00000100:00100000:1.0:1786400742.187585:0:5769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400742.187609:0:5769:0:(client.c:2702:ptlrpc_set_wait()) set 000000000f6c9176 going to sleep for 11 seconds 00000100:00100000:1.0:1786400742.187623:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872093440 00000100:00100000:1.0:1786400742.187627:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872093440 00000100:00100000:1.0:1786400742.187654:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1786400742.187659:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad3a29bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+11:5769:x1873176872093440:12345-0@lo:501: 00000100:00100000:1.0:1786400742.189070:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad3a29bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+11:5769:x1873176872093440:12345-0@lo:501: Request processed in 1404us (1478us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400742.189105:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1786400742.189320:0:5769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c12d6f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:5769:1873176872093440:0@lo:501: 00000100:00100000:2.0:1786400742.189445:0:5769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d0af4d27 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:5769:1873176872093568:0@lo:503: 00000100:00100000:2.0:1786400742.189494:0:5769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400742.189530:0:5769:0:(client.c:2702:ptlrpc_set_wait()) set 0000000091a28d43 going to sleep for 11 seconds 00000100:00100000:0.0:1786400742.189557:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872093568 00000100:00100000:0.0:1786400742.189563:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872093568 00000100:00100000:0.0:1786400742.189613:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1786400742.189622:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000efc1cb46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+11:5769:x1873176872093568:12345-0@lo:503: 00000040:00080000:0.0:1786400742.189672:0:5781:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1786400742.189745:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000efc1cb46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+11:5769:x1873176872093568:12345-0@lo:503: Request processed in 124us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400742.189752:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1786400742.189790:0:5769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d0af4d27 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:5769:1873176872093568:0@lo:503: 00000040:00080000:2.0:1786400742.191244:0:5816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1786400742.191582:0:5769:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1786400742.191615:0:5769:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1786400742.191635:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: 00000000945ba3c4/0x5ccaaf4f3cb1d638 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d63f expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400742.191648:0:5769:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: 00000000945ba3c4/0x5ccaaf4f3cb1d638 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d63f expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400742.191690:0:5769:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1786400742.191693:0:5769:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d6fc307d800 10000000:01000000:3.0:1786400742.191695:0:5769:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d6fc307d800 10000000:01000000:3.0:1786400742.191699:0:5769:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1786400742.191704:0:5769:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d6fc307d800 from 1 10000000:01000000:3.0:1786400742.191706:0:5769:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1786400742.191736:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: 000000002b33165a/0x5ccaaf4f3cb1d646 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400742.191744:0:5769:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: 000000002b33165a/0x5ccaaf4f3cb1d646 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400742.191764:0:5769:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: 000000002b33165a/0x5ccaaf4f3cb1d646 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400742.191784:0:5769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dfbdfd6e pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:5769:1873176872093696:0@lo:101: 00000100:00100000:3.0:1786400742.191839:0:5769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400742.191882:0:5769:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b9b3f79e going to sleep for 11 seconds 00000100:00100000:1.0:1786400742.191990:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872093696 00000100:00100000:1.0:1786400742.191997:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872093696 00000100:00100000:1.0:1786400742.192055:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1786400742.192063:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6f11c18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+11:5769:x1873176872093696:12345-0@lo:101: 00010000:00010000:1.0:1786400742.192075:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400742.192104:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000084659608/0x5ccaaf4f3cb1d64d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d646 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400742.192135:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000084659608/0x5ccaaf4f3cb1d64d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d646 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400742.192145:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000084659608/0x5ccaaf4f3cb1d64d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d646 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400742.192154:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000084659608, rc 0) 00000100:00100000:1.0:1786400742.192302:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6f11c18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+12:5769:x1873176872093696:12345-0@lo:101: Request processed in 240us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400742.192320:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1786400742.192453:0:5769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dfbdfd6e pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:5769:1873176872093696:0@lo:101: 00010000:00010000:3.0:1786400742.192466:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: 000000002b33165a/0x5ccaaf4f3cb1d646 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d64d expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400742.192473:0:5769:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: 000000002b33165a/0x5ccaaf4f3cb1d646 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d64d expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400742.192522:0:5769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dfbdfd6e pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:5769:1873176872093824:0@lo:501: 00000100:00100000:3.0:1786400742.192547:0:5769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400742.192579:0:5769:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b9b3f79e going to sleep for 11 seconds 00000100:00100000:2.0:1786400742.192771:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872093824 00000100:00100000:2.0:1786400742.192776:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872093824 00000100:00100000:2.0:1786400742.192809:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1786400742.192816:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f2cf7ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+12:5769:x1873176872093824:12345-0@lo:501: 00000100:00100000:2.0:1786400742.193079:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f2cf7ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+12:5769:x1873176872093824:12345-0@lo:501: Request processed in 263us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400742.193108:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1786400742.193459:0:5769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dfbdfd6e pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:5769:1873176872093824:0@lo:501: 00000100:00100000:3.0:1786400742.193491:0:5769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dfbdfd6e pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:5769:1873176872093952:0@lo:503: 00000100:00100000:3.0:1786400742.193533:0:5769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400742.193568:0:5769:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b9b3f79e going to sleep for 11 seconds 00000100:00100000:1.0:1786400742.193620:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872093952 00000100:00100000:1.0:1786400742.193627:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872093952 00000100:00100000:1.0:1786400742.193664:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1786400742.193671:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008da28c70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+12:5769:x1873176872093952:12345-0@lo:503: 00000100:00100000:1.0:1786400742.194070:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008da28c70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+12:5769:x1873176872093952:12345-0@lo:503: Request processed in 399us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400742.194078:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1786400742.194513:0:5769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dfbdfd6e pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:5769:1873176872093952:0@lo:503: 00000100:00100000:3.0:1786400742.195549:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dfbdfd6e pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:5817:1873176872094080:0@lo:502: 00000100:00100000:3.0:1786400742.195610:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400742.195677:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set 0000000083ae0980 going to sleep for 11 seconds 00000100:00100000:2.0:1786400742.195720:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872094080 00000100:00100000:2.0:1786400742.195726:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872094080 00000100:00100000:2.0:1786400742.195875:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1786400742.195883:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4069b9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+12:5817:x1873176872094080:12345-0@lo:502: 00000100:00100000:3.0:1786400742.196626:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dfbdfd6e pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:5817:1873176872094080:0@lo:502: 00000020:01000004:3.0:1786400742.196860:0:5817:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1786400742.196875:0:5817:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000005032a0c2) 00000020:00000080:3.0:1786400742.196894:0:5817:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1786400742.197076:0:5817:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c5e820e0 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1786400742.197080:0:5817:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000c5e820e0 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1786400742.197082:0:5817:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000c5e820e0 4 00010000:00080000:3.0:1786400742.197142:0:5817:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000be91595d@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.108@tcp at head 00000100:00100000:2.0:1786400742.199441:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4069b9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+12:5817:x1873176872094080:12345-0@lo:502: Request processed in 3551us (3824us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400742.199456:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1786400742.201105:0:5817:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1786400742.203190:0:5817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1786400742.203226:0:5817:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1786400742.203238:0:5817:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5ccaaf4f3cb1d65b 00000100:00080000:3.0:1786400742.203249:0:5817:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1786400742.203255:0:5817:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000be91595d using connection 192.168.204.108@tcp/0@lo 00000100:00100000:3.0:1786400742.203290:0:5817:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000dfbdfd6e x1873176872094208/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1786400742.203319:0:5817:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1786400742.203514:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dfbdfd6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873176872094208:0@lo:38: 00000100:00100000:1.0:1786400742.203586:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400742.203912:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e3274d09 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:5817:1873176872094336:0@lo:502: 00000100:00100000:1.0:1786400742.203956:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400742.203969:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set 000000000f6c9176 going to sleep for 11 seconds 00000100:00100000:0.0:1786400742.204041:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872094208 00000100:00100000:0.0:1786400742.204049:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872094208 00000100:00100000:0.0:1786400742.204105:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1786400742.204111:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003723eeaf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1873176872094208:12345-0@lo:38: 00000100:00100000:0.0:1786400742.204165:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003723eeaf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1873176872094208:12345-0@lo:38: Request processed in 52us (579us total) trans 0 rc -11/-11 00000100:00100000:0.0:1786400742.204172:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1786400742.204221:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1786400742.204229:0:3305:0:(import.c:65:import_set_state_nolock()) 00000000be91595d lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786400742.204233:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1786400742.204235:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dfbdfd6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873176872094208:0@lo:38: 00000100:00100000:0.0:1786400742.204260:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872094336 00000100:00100000:0.0:1786400742.204264:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872094336 00000100:00100000:0.0:1786400742.204294:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1786400742.204300:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae3ec5d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+12:5817:x1873176872094336:12345-0@lo:502: 00000100:00100000:0.0:1786400742.204507:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae3ec5d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+12:5817:x1873176872094336:12345-0@lo:502: Request processed in 207us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400742.204514:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1786400742.204561:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e3274d09 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:5817:1873176872094336:0@lo:502: 00000040:00080000:0.0:1786400742.204583:0:5817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1786400742.205258:0:5769:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1786400742.205277:0:5769:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1786400742.205296:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: 000000002b33165a/0x5ccaaf4f3cb1d646 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d64d expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400742.205307:0:5769:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: 000000002b33165a/0x5ccaaf4f3cb1d646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d64d expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1786400742.206239:0:5769:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1786400742.206243:0:5769:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1786400742.206244:0:5769:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786400742.206246:0:5769:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786400742.206247:0:5769:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786400742.206255:0:5769:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786400742.206256:0:5769:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1786400742.206257:0:5769:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1786400742.206259:0:5769:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1786400742.206260:0:5769:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1786400742.206261:0:5769:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786400742.206262:0:5769:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1786400742.206266:0:5769:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1786400742.206268:0:5769:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1786400742.206269:0:5769:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1786400742.206270:0:5769:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786400742.206271:0:5769:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786400742.206272:0:5769:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786400742.206273:0:5769:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786400742.206274:0:5769:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1786400742.206275:0:5769:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1786400742.206275:0:5769:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1786400742.206276:0:5769:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1786400742.206277:0:5769:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786400742.206278:0:5769:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1786400742.206300:0:5769:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1786400742.206320:0:5769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c560dd72 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:5769:1873176872094464:0@lo:253: 00000100:00100000:3.0:1786400742.206517:0:5769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400742.206556:0:5769:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a2263ab2 going to sleep for 11 seconds 00000100:00100000:2.0:1786400742.206586:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872094464 00000100:00100000:2.0:1786400742.206593:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872094464 00000100:00100000:2.0:1786400742.206788:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1786400742.206797:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e09d5975 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+12:5769:x1873176872094464:12345-0@lo:253: 20000000:01000000:2.0:1786400742.206830:0:5780:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1786400742.206842:0:5780:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1786400742.234459:0:5780:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1786400742.234514:0:5780:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1786400742.234585:0:5804:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1786400742.234591:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1786400742.234612:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f97f4c86/0x5ccaaf4f3cb1d662 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400742.234645:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c52dcdc7/0x5ccaaf4f3cb1d631 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d62a expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400742.234653:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000f97f4c86/0x5ccaaf4f3cb1d662 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400742.234694:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c52dcdc7/0x5ccaaf4f3cb1d631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d62a expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400742.234710:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c52dcdc7/0x5ccaaf4f3cb1d631 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d62a expref: 12 pid: 5783 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400742.234724:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f361de3e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5804:1873176872094592:0@lo:104: 00000100:00100000:0.0:1786400742.234924:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400742.234979:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e48e7972 going to sleep for 11 seconds 00000100:00100000:1.0:1786400742.235058:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872094592 00000100:00100000:1.0:1786400742.235070:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872094592 00000100:00100000:1.0:1786400742.235223:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786400742.235234:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005dcadf22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:97b0324f-e214-4822-8711-e150ddac2a7e+3:5804:x1873176872094592:12345-0@lo:104: 00010000:00010000:1.0:1786400742.235247:0:5771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.108@tcp lock: 000000001253adbc/0x5ccaaf4f3cb1d62a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d631 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400742.235310:0:5771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786400742.235316:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005dcadf22 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:97b0324f-e214-4822-8711-e150ddac2a7e+3:5804:x1873176872094592:12345-0@lo:104: Request processed in 85us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400742.235323:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1786400742.235386:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f361de3e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5804:1873176872094592:0@lo:104: 00010000:00010000:0.0:1786400742.235406:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000f97f4c86/0x5ccaaf4f3cb1d662 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400742.235476:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786400742.235489:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: 000000001253adbc/0x5ccaaf4f3cb1d62a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d631 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400742.235495:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001253adbc already unused, calling callback (00000000d524a8d3) 10000000:00010000:1.0:1786400742.235498:0:5776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: 000000001253adbc/0x5ccaaf4f3cb1d62a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5ccaaf4f3cb1d631 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400742.235504:0:5776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: 000000001253adbc/0x5ccaaf4f3cb1d62a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5ccaaf4f3cb1d631 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786400742.235510:0:5776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: 000000001253adbc/0x5ccaaf4f3cb1d62a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5ccaaf4f3cb1d631 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400742.235514:0:5776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1786400742.235620:0:5776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: 000000001253adbc/0x5ccaaf4f3cb1d62a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d631 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400742.235627:0:5776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1786400742.235716:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e415d438 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:97b0324f-e214-4822-8711-e150ddac2a7e:3307:1873176872094720:0@lo:103: 00000100:00100000:3.0:1786400742.235760:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786400742.235865:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: 000000001253adbc/0x5ccaaf4f3cb1d62a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d631 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400742.235872:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: 000000001253adbc/0x5ccaaf4f3cb1d62a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d631 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400742.235887:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400742.235889:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400742.235890:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400742.235917:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872094720 00000100:00100000:1.0:1786400742.235921:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872094720 00010000:00010000:1.0:1786400742.235939:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c52dcdc7/0x5ccaaf4f3cb1d631 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d62a expref: 13 pid: 5783 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400742.235971:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786400742.235977:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029193ede pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:97b0324f-e214-4822-8711-e150ddac2a7e+13:3307:x1873176872094720:12345-0@lo:103: 00010000:00010000:1.0:1786400742.235987:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400742.235991:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c52dcdc7/0x5ccaaf4f3cb1d631 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d62a expref: 13 pid: 5783 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400742.236000:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c52dcdc7/0x5ccaaf4f3cb1d631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d62a expref: 13 pid: 5783 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400742.236026:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c52dcdc7/0x5ccaaf4f3cb1d631 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d62a expref: 13 pid: 5783 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400742.236039:0:5773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000f97f4c86/0x5ccaaf4f3cb1d662 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400742.236045:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f97f4c86/0x5ccaaf4f3cb1d662 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1786400742.236057:0:5773:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001467248s 00010000:00010000:1.0:1786400742.236060:0:5773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f97f4c86/0x5ccaaf4f3cb1d662 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400742.236066:0:5773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f97f4c86/0x5ccaaf4f3cb1d662 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400742.236072:0:5773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f97f4c86/0x5ccaaf4f3cb1d662 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400742.236077:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f97f4c86/0x5ccaaf4f3cb1d662 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400742.236121:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f97f4c86 already unused, calling callback (000000001cb7fc51) 00010000:00010000:1.0:1786400742.236125:0:5773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f97f4c86/0x5ccaaf4f3cb1d662 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400742.236131:0:5773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f97f4c86/0x5ccaaf4f3cb1d662 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400742.236143:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f97f4c86/0x5ccaaf4f3cb1d662 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400742.236152:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400742.236267:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029193ede pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:97b0324f-e214-4822-8711-e150ddac2a7e+12:3307:x1873176872094720:12345-0@lo:103: Request processed in 290us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400742.236274:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1786400742.236331:0:5804:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000f97f4c86/0x5ccaaf4f3cb1d662 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400742.236338:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f97f4c86/0x5ccaaf4f3cb1d662 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400742.236343:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f97f4c86/0x5ccaaf4f3cb1d662 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400742.237453:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e415d438 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:97b0324f-e214-4822-8711-e150ddac2a7e:3307:1873176872094720:0@lo:103: 00000100:00100000:1.0:1786400742.242438:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e09d5975 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+11:5769:x1873176872094464:12345-0@lo:253: Request processed in 35635us (35913us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400742.242454:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1786400742.242555:0:5769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c560dd72 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:5769:1873176872094464:0@lo:253: 10000000:01000000:3.0:1786400742.242571:0:5769:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1786400742.242575:0:5769:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1786400742.242577:0:5769:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1786400742.242578:0:5769:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786400742.242579:0:5769:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786400742.242580:0:5769:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786400742.242582:0:5769:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786400742.242600:0:5769:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1786400742.242602:0:5769:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1786400742.242603:0:5769:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1786400742.242604:0:5769:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1786400742.242606:0:5769:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786400742.242607:0:5769:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1786400742.242621:0:5769:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1786400742.247415:0:5769:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1786400742.248371:0:5769:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1786400742.248614:0:5769:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1786400742.248910:0:5769:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1786400742.249289:0:5769:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1786400742.249468:0:5769:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1786400742.250814:0:5769:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1786400742.250985:0:5769:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1786400742.251760:0:5769:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1786400742.251945:0:5769:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1786400742.252347:0:5769:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1786400742.252598:0:5769:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1786400742.285871:0:5769:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00010000:00010000:0.0:1786400742.320041:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1786400742.322502:0:5769:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1786400742.322644:0:5822:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1786400742.322648:0:5822:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1786400742.323194:0:5823:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1786400742.338212:0:5769:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1786400742.341301:0:5769:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1786400742.341719:0:5769:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1786400742.341734:0:5769:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1786400742.343434:0:5769:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1786400742.344352:0:5769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1786400742.344814:0:5769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1786400742.344845:0:5769:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1786400742.350432:0:5769:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1786400742.350647:0:5769:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1786400742.354367:0:5769:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1786400742.354533:0:5769:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1786400742.354668:0:5769:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1786400742.356401:0:5769:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1786400742.356596:0:5769:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1786400742.356766:0:5769:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1786400742.357473:0:5769:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1786400742.357648:0:5769:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1786400742.357980:0:5769:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1786400742.359432:0:5769:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1786400742.359599:0:5769:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1786400742.359763:0:5769:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1786400742.361821:0:5769:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1786400742.362175:0:5769:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1786400742.362318:0:5769:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1786400742.362578:0:5769:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1786400742.362855:0:5769:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1786400742.363263:0:5769:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1786400742.363413:0:5769:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1786400742.363577:0:5769:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1786400742.363847:0:5769:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1786400742.364277:0:5769:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1786400742.364422:0:5769:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1786400742.364574:0:5769:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1786400742.364708:0:5769:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1786400742.365284:0:5769:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1786400742.365440:0:5769:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1786400742.365593:0:5769:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1786400742.365983:0:5769:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1786400742.366205:0:5769:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1786400742.366429:0:5769:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1786400742.366586:0:5769:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1786400742.366800:0:5769:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1786400742.374453:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1786400742.437960:0:5769:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1786400742.438017:0:5769:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbdcdc18cf988 00100000:10000000:1.0:1786400742.438026:0:5769:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1786400742.440977:0:5769:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1786400742.440998:0:5769:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.108@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1786400742.441027:0:5769:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1786400742.441054:0:5769:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1786400742.496410:0:5823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1786400742.496496:0:5823:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1786400742.496500:0:5823:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1786400743.343168:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400744.370529:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400745.390385:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400746.414472:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786400746.927258:0:6065:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg408-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:0.0:1786400747.246232:0:5785:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1786400747.246241:0:5785:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9d6fc307d800 from 3 10000000:01000000:0.0:1786400747.246246:0:5785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1786400747.246297:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: 00000000acf145ae/0x5ccaaf4f3cb1d669 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400747.246309:0:5785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: 00000000acf145ae/0x5ccaaf4f3cb1d669 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400747.246319:0:5785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: 00000000acf145ae/0x5ccaaf4f3cb1d669 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400747.246343:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f361de3e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872094848:0@lo:101: 00000100:00100000:0.0:1786400747.246411:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400747.246485:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set 00000000353758ed going to sleep for 11 seconds 00000100:00100000:3.0:1786400747.246613:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872094848 00000100:00100000:3.0:1786400747.246621:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872094848 00000100:00100000:3.0:1786400747.246697:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1786400747.246705:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe54ba87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+11:5785:x1873176872094848:12345-0@lo:101: 00010000:00010000:3.0:1786400747.246718:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400747.246742:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d73ad48d/0x5ccaaf4f3cb1d670 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d669 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400747.246763:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d73ad48d/0x5ccaaf4f3cb1d670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d669 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400747.246792:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d73ad48d/0x5ccaaf4f3cb1d670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d669 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400747.246800:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d73ad48d, rc 0) 00000100:00100000:3.0:1786400747.246848:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe54ba87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+12:5785:x1873176872094848:12345-0@lo:101: Request processed in 144us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400747.246856:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1786400747.246938:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f361de3e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872094848:0@lo:101: 00010000:00010000:2.0:1786400747.246953:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: 00000000acf145ae/0x5ccaaf4f3cb1d669 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d670 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400747.246962:0:5785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: 00000000acf145ae/0x5ccaaf4f3cb1d669 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d670 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400747.247009:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d0af4d27 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872094976:0@lo:256: 00000100:00100000:2.0:1786400747.247058:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400747.247113:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set 000000007655db00 going to sleep for 11 seconds 00000100:00100000:3.0:1786400747.247175:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872094976 00000100:00100000:3.0:1786400747.247179:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872094976 00000100:00100000:3.0:1786400747.247209:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1786400747.247215:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009fd79a8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+12:5785:x1873176872094976:12345-0@lo:256: 20000000:01000000:3.0:1786400747.247228:0:5780:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1786400747.247242:0:5780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1786400747.247244:0:5780:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1786400747.247314:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009fd79a8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+12:5785:x1873176872094976:12345-0@lo:256: Request processed in 99us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400747.247321:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1786400747.247397:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d0af4d27 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872094976:0@lo:256: 10000000:01000000:2.0:1786400747.247433:0:5785:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1786400747.247439:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: 00000000acf145ae/0x5ccaaf4f3cb1d669 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d670 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400747.247446:0:5785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: 00000000acf145ae/0x5ccaaf4f3cb1d669 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d670 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1786400747.247639:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1786400747.247644:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1786400747.247647:0:36:0:(import.c:65:import_set_state_nolock()) 00000000be91595d lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786400747.247665:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000be91595d using connection 192.168.204.108@tcp/0@lo 00000100:00100000:1.0:1786400747.247689:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004751a102 x1873176872095104/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786400747.247805:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004751a102 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873176872095104:0@lo:38: 00000100:00100000:0.0:1786400747.247864:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400747.248155:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872095104 00000100:00100000:3.0:1786400747.248160:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872095104 00000100:00100000:3.0:1786400747.248194:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1786400747.248199:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b62f7287 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1873176872095104:12345-0@lo:38: 00010000:00080000:3.0:1786400747.248217:0:5790:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:3.0:1786400747.248252:0:5790:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5ccaaf4f3cb1d677 00000004:00100000:3.0:1786400747.248306:0:5790:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1786400747.249956:0:5790:0:(import.c:65:import_set_state_nolock()) 000000008722b645 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786400747.250358:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b62f7287 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1873176872095104:12345-0@lo:38: Request processed in 2154us (2491us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400747.250372:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1786400747.250561:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004751a102 x1873176872095104/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786400757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786400747.250578:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1786400747.250587:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1786400747.250592:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1786400747.250594:0:3305:0:(import.c:65:import_set_state_nolock()) 00000000be91595d lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1786400747.250599:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004751a102 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873176872095104:0@lo:38: 00010000:00010000:2.0:1786400747.439141:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400748.462480:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400749.486878:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400750.510434:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400751.535334:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1786400752.030423:0:6267:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007fff93127c60 00000020:00000080:3.0:1786400752.030444:0:6267:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:3.0:1786400752.030457:0:6267:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:3.0:1786400752.030477:0:6267:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff93129ef0 20000000:00000080:3.0:1786400752.030485:0:6267:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d6fc3312400 uarg=0000000000000000 20000000:01000000:3.0:1786400752.030533:0:6267:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1786400752.030542:0:6267:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1786400752.030548:0:6267:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1786400752.031202:0:6267:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1786400752.031217:0:6267:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1786400752.035331:0:6267:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786400752.035665:0:6267:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1786400752.035813:0:6267:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1786400752.035879:0:6267:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1786400752.035899:0:6267:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1786400752.035923:0:6267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a5459cc9/0x5ccaaf4f3cb1d67e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400752.035947:0:6267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c76c5528/0x5ccaaf4f3cb1d63f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d638 expref: 11 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400752.035956:0:6267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000a5459cc9/0x5ccaaf4f3cb1d67e lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400752.036005:0:6267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c76c5528/0x5ccaaf4f3cb1d63f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d638 expref: 11 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400752.036026:0:6267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c76c5528/0x5ccaaf4f3cb1d63f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d638 expref: 11 pid: 5781 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400752.036044:0:6267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c560dd72 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6267:1873176872095232:0@lo:104: 00000100:00100000:3.0:1786400752.036162:0:6267:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400752.036234:0:6267:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e77e0cc4 going to sleep for 11 seconds 00000100:00100000:1.0:1786400752.039455:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872095232 00000100:00100000:1.0:1786400752.039471:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872095232 00000100:00100000:1.0:1786400752.039565:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786400752.039576:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5722b5d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:97b0324f-e214-4822-8711-e150ddac2a7e+3:6267:x1873176872095232:12345-0@lo:104: 00010000:00010000:1.0:1786400752.039597:0:5771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.108@tcp lock: 00000000945ba3c4/0x5ccaaf4f3cb1d638 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d63f expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400752.039735:0:5771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786400752.039741:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5722b5d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:97b0324f-e214-4822-8711-e150ddac2a7e+3:6267:x1873176872095232:12345-0@lo:104: Request processed in 168us (3580us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400752.039749:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1786400752.039931:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786400752.039938:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: 00000000945ba3c4/0x5ccaaf4f3cb1d638 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d63f expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400752.039947:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000945ba3c4 already unused, calling callback (00000000d524a8d3) 10000000:00010000:0.0:1786400752.039950:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: 00000000945ba3c4/0x5ccaaf4f3cb1d638 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5ccaaf4f3cb1d63f expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400752.039959:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: 00000000945ba3c4/0x5ccaaf4f3cb1d638 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5ccaaf4f3cb1d63f expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786400752.039966:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: 00000000945ba3c4/0x5ccaaf4f3cb1d638 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5ccaaf4f3cb1d63f expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786400752.039973:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1786400752.040027:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: 00000000945ba3c4/0x5ccaaf4f3cb1d638 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d63f expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400752.040034:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786400752.040081:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: 00000000945ba3c4/0x5ccaaf4f3cb1d638 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d63f expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400752.040115:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: 00000000945ba3c4/0x5ccaaf4f3cb1d638 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d63f expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400752.040138:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400752.040140:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400752.040141:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400752.040204:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786400752.040218:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004c4971a9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:97b0324f-e214-4822-8711-e150ddac2a7e:3309:1873176872095360:0@lo:103: 00000100:00100000:0.0:1786400752.040270:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400752.040354:0:6267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c560dd72 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6267:1873176872095232:0@lo:104: 00010000:00010000:0.0:1786400752.040379:0:6267:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000a5459cc9/0x5ccaaf4f3cb1d67e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400752.040617:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872095360 00000100:00100000:1.0:1786400752.040622:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872095360 00010000:00010000:1.0:1786400752.040644:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c76c5528/0x5ccaaf4f3cb1d63f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d638 expref: 12 pid: 5781 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400752.040825:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786400752.040834:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa21ebaf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:97b0324f-e214-4822-8711-e150ddac2a7e+12:3309:x1873176872095360:12345-0@lo:103: 00010000:00010000:1.0:1786400752.040849:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400752.040861:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c76c5528/0x5ccaaf4f3cb1d63f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d638 expref: 12 pid: 5781 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400752.040874:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c76c5528/0x5ccaaf4f3cb1d63f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d638 expref: 12 pid: 5781 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400752.040892:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c76c5528/0x5ccaaf4f3cb1d63f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d638 expref: 12 pid: 5781 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400752.040908:0:5773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000a5459cc9/0x5ccaaf4f3cb1d67e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400752.040916:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a5459cc9/0x5ccaaf4f3cb1d67e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400752.040932:0:5773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a5459cc9/0x5ccaaf4f3cb1d67e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400752.040939:0:5773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a5459cc9/0x5ccaaf4f3cb1d67e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400752.040945:0:5773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a5459cc9/0x5ccaaf4f3cb1d67e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400752.040952:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a5459cc9/0x5ccaaf4f3cb1d67e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400752.040957:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a5459cc9 already unused, calling callback (000000001cb7fc51) 00010000:00010000:1.0:1786400752.040961:0:5773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a5459cc9/0x5ccaaf4f3cb1d67e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400752.040968:0:5773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a5459cc9/0x5ccaaf4f3cb1d67e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400752.040995:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a5459cc9/0x5ccaaf4f3cb1d67e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400752.041007:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400752.041049:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa21ebaf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:97b0324f-e214-4822-8711-e150ddac2a7e+11:3309:x1873176872095360:12345-0@lo:103: Request processed in 216us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400752.041057:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1786400752.041126:0:6267:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000a5459cc9/0x5ccaaf4f3cb1d67e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400752.041133:0:6267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a5459cc9/0x5ccaaf4f3cb1d67e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400752.041138:0:6267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a5459cc9/0x5ccaaf4f3cb1d67e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400752.044459:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004c4971a9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:97b0324f-e214-4822-8711-e150ddac2a7e:3309:1873176872095360:0@lo:103: 00000100:00100000:1.0:1786400752.366220:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786400752.366251:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000089dd1059 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873176872095488:0@lo:400: 00000100:00100000:1.0:1786400752.366344:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400752.366428:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872095488 00000100:00100000:1.0:1786400752.366437:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872095488 00000100:00100000:1.0:1786400752.366491:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786400752.366500:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a4b70157 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873176872095488:12345-0@lo:400: 00000100:00100000:1.0:1786400752.366560:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a4b70157 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873176872095488:12345-0@lo:400: Request processed in 61us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400752.366568:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1786400752.366618:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000089dd1059 x1873176872095488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400752.366633:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000089dd1059 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873176872095488:0@lo:400: 00010000:00010000:3.0:1786400752.562341:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400753.587721:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400754.613196:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400755.637688:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1786400756.462295:0:5785:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1786400756.462304:0:5785:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6fc307d800 from 1 10000000:01000000:3.0:1786400756.462309:0:5785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1786400756.462358:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: 00000000da8a8e28/0x5ccaaf4f3cb1d685 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400756.462370:0:5785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: 00000000da8a8e28/0x5ccaaf4f3cb1d685 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400756.462381:0:5785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: 00000000da8a8e28/0x5ccaaf4f3cb1d685 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400756.462406:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a95679a7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872095616:0@lo:101: 00000100:00100000:3.0:1786400756.462666:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400756.462875:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cf686622 going to sleep for 11 seconds 00000100:00100000:1.0:1786400756.463134:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872095616 00000100:00100000:1.0:1786400756.463143:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872095616 00000100:00100000:1.0:1786400756.463193:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1786400756.463211:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089c44f01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+11:5785:x1873176872095616:12345-0@lo:101: 00010000:00010000:1.0:1786400756.463225:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400756.463241:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fff4c76c/0x5ccaaf4f3cb1d68c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d685 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400756.463266:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fff4c76c/0x5ccaaf4f3cb1d68c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d685 expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400756.463276:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fff4c76c/0x5ccaaf4f3cb1d68c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d685 expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400756.463284:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fff4c76c, rc 0) 00000100:00100000:1.0:1786400756.463346:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089c44f01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+12:5785:x1873176872095616:12345-0@lo:101: Request processed in 135us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400756.463354:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1786400756.463657:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a95679a7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872095616:0@lo:101: 00010000:00010000:3.0:1786400756.463673:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: 00000000da8a8e28/0x5ccaaf4f3cb1d685 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d68c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400756.463681:0:5785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: 00000000da8a8e28/0x5ccaaf4f3cb1d685 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d68c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400756.463802:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a95679a7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872095744:0@lo:501: 00000100:00100000:3.0:1786400756.463835:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400756.463868:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cf686622 going to sleep for 11 seconds 00000100:00100000:1.0:1786400756.464499:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872095744 00000100:00100000:1.0:1786400756.464505:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872095744 00000100:00100000:1.0:1786400756.464541:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1786400756.464548:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001bb2c116 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+12:5785:x1873176872095744:12345-0@lo:501: 00000100:00100000:1.0:1786400756.464898:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001bb2c116 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+12:5785:x1873176872095744:12345-0@lo:501: Request processed in 349us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400756.464906:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1786400756.464950:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a95679a7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872095744:0@lo:501: 00000100:00100000:1.0:1786400756.464987:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000089dd1059 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872095872:0@lo:503: 00000100:00100000:1.0:1786400756.465028:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400756.465051:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fdfb85ac going to sleep for 11 seconds 00000100:00100000:1.0:1786400756.465062:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872095872 00000100:00100000:1.0:1786400756.465072:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872095872 00000100:00100000:1.0:1786400756.465112:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1786400756.465375:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032975e53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+12:5785:x1873176872095872:12345-0@lo:503: 00000100:00100000:1.0:1786400756.465549:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032975e53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+12:5785:x1873176872095872:12345-0@lo:503: Request processed in 431us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400756.465556:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1786400756.465636:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000089dd1059 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872095872:0@lo:503: 00000100:00100000:1.0:1786400756.467035:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000efee1164 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:6520:1873176872096000:0@lo:502: 00000100:00100000:1.0:1786400756.467401:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400756.467481:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cbfd0442 going to sleep for 11 seconds 00000100:00100000:0.0:1786400756.467579:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872096000 00000100:00100000:0.0:1786400756.467586:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872096000 00000100:00100000:0.0:1786400756.467670:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1786400756.467678:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fef7f64f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+12:6520:x1873176872096000:12345-0@lo:502: 00000100:00100000:0.0:1786400756.467899:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fef7f64f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+12:6520:x1873176872096000:12345-0@lo:502: Request processed in 222us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400756.467907:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1786400756.467978:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000efee1164 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:6520:1873176872096000:0@lo:502: 00000020:01000000:3.0:1786400756.468003:0:6520:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786400756.468012:0:6520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786400756.468018:0:6520:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1786400756.468028:0:6520:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d6fc307d800 00000020:00000080:3.0:1786400756.468030:0:6520:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1786400756.468069:0:6520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:6520:1873176872096128:0@lo:502: 00000100:00100000:3.0:1786400756.468199:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400756.468351:0:6520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc5455cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786400756.468384:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872096128 00000100:00100000:1.0:1786400756.468389:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872096128 00000100:00100000:1.0:1786400756.468409:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1786400756.468415:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+12:6520:x1873176872096128:12345-0@lo:502: 00000100:00100000:1.0:1786400756.468997:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+12:6520:x1873176872096128:12345-0@lo:502: Request processed in 579us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400756.469004:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1786400756.469273:0:6520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:6520:1873176872096128:0@lo:502: 00000020:01000000:3.0:1786400756.469297:0:6520:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786400756.469303:0:6520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786400756.469305:0:6520:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1786400756.469310:0:6520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1786400756.469534:0:5785:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1786400756.469554:0:5785:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1786400756.469563:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1d685 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d68c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400756.469574:0:5785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1d685 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d68c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400756.654900:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400757.487439:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:97b0324f-e214-4822-8711-e150ddac2a7e:3306:1873176872096256:0@lo:400: 00000100:00100000:3.0:1786400757.487510:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400757.487553:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786400757.487559:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872096384:0@lo:400: 00000100:00100000:3.0:1786400757.487588:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400757.487622:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872096256 00000100:00100000:3.0:1786400757.487630:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872096256 00000100:00100000:3.0:1786400757.487672:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1786400757.487682:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+12:3306:x1873176872096256:12345-0@lo:400: 00000100:00100000:3.0:1786400757.488122:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+12:3306:x1873176872096256:12345-0@lo:400: Request processed in 439us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400757.488130:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1786400757.488166:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872096384 00000100:00100000:3.0:1786400757.488170:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872096384 00000100:00100000:3.0:1786400757.488196:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1786400757.488202:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872096384:12345-0@lo:400: 00000100:00100000:3.0:1786400757.488242:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872096384:12345-0@lo:400: Request processed in 41us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400757.488248:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1786400757.488334:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d6ff692e300 x1873176872096384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400757.488348:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872096384:0@lo:400: 00000100:00100000:0.0:1786400757.488357:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:97b0324f-e214-4822-8711-e150ddac2a7e:3306:1873176872096256:0@lo:400: 00010000:00010000:1.0:1786400757.678214:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1786400757.923971:0:6588:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1786400757.923976:0:6588:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1786400757.924141:0:6588:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9d6fc49f0000 00000020:01000004:2.0:1786400757.924165:0:6588:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1786400757.924177:0:6588:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1786400757.924197:0:6588:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9d6fe9038000) 00000020:00000080:2.0:1786400757.924215:0:6588:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1786400757.943671:0:6588:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1786400757.943966:0:6588:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1786400757.972759:0:6588:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1786400757.982383:0:6588:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1786400757.982504:0:6588:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1786400757.982566:0:6588:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1786400757.982593:0:6588:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1786400757.982949:0:6588:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1786400757.982959:0:6588:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1786400757.982969:0:6588:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5ccaaf4f3cb1d69a 00000020:01000004:2.0:1786400757.982976:0:6588:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1786400757.982998:0:6588:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.108@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1786400757.983002:0:6588:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.108@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1786400757.983007:0:6588:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1786400757.983012:0:6588:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1786400757.983022:0:6588:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9d6fe903cd40) 00000020:00000080:2.0:1786400757.983041:0:6588:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1786400757.986012:0:6588:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786400757.987009:0:6588:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1786400757.987018:0:6588:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1786400757.990920:0:6588:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1786400757.990934:0:6588:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1786400757.992453:0:6588:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1786400757.992464:0:6588:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1786400757.996730:0:6588:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1786400757.996972:0:6588:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1786400757.996979:0:6588:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1786400757.999047:0:6588:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1786400757.999061:0:6588:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1786400758.037080:0:6588:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1786400758.037577:0:6588:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1786400758.037584:0:6588:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1786400758.044780:0:6588:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1786400758.044902:0:6588:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1786400758.046055:0:6588:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1786400758.046066:0:6588:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1786400758.052538:0:6588:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1786400758.052874:0:6588:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1786400758.052882:0:6588:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1786400758.054325:0:6588:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1786400758.054338:0:6588:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1786400758.173850:0:6588:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1786400758.174031:0:6588:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1786400758.174038:0:6588:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1786400758.178730:0:6588:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1786400758.178746:0:6588:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1786400758.179704:0:6588:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1786400758.179731:0:6588:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1786400758.179738:0:6588:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.108@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1786400758.221954:0:6588:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.108@tcp ctxt 0 is initialized 00000020:01000004:2.0:1786400758.221994:0:6588:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.108@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1786400758.221999:0:6588:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1786400758.222001:0:6588:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1786400758.222003:0:6588:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786400758.222004:0:6588:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786400758.222005:0:6588:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786400758.222006:0:6588:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786400758.222007:0:6588:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1786400758.222009:0:6588:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1786400758.222010:0:6588:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1786400758.222012:0:6588:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786400758.222013:0:6588:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1786400758.222017:0:6588:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1786400758.222019:0:6588:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1786400758.222020:0:6588:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1786400758.222022:0:6588:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786400758.222023:0:6588:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786400758.222024:0:6588:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786400758.222025:0:6588:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786400758.222026:0:6588:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1786400758.222027:0:6588:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1786400758.222028:0:6588:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1786400758.222029:0:6588:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786400758.222030:0:6588:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1786400758.222066:0:6588:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1786400758.222158:0:6588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872096512:0@lo:253: 00000100:00100000:2.0:1786400758.222231:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400758.222296:0:6588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc38a5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400758.222405:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872096512 00000100:00100000:0.0:1786400758.222546:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872096512 00000100:00100000:3.0:1786400758.222667:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1786400758.222678:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+12:6588:x1873176872096512:12345-0@lo:253: 20000000:01000000:3.0:1786400758.222733:0:5781:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1786400758.222737:0:5781:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1786400758.222741:0:5781:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1786400758.222744:0:5781:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1786400758.223602:0:5781:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786400758.223849:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1786400758.223862:0:5781:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1786400758.223899:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1786400758.223906:0:5781:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1786400758.223934:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1786400758.223995:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1786400758.224392:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1786400758.224413:0:5781:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.108@tcp 20000000:01000000:3.0:1786400758.224415:0:5781:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.108@tcp (null) (null) (null) 00000040:00080000:3.0:1786400758.224449:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1786400758.224457:0:5781:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1786400758.224505:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1786400758.224513:0:5781:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.108@tcp (null) (null) 00000040:00080000:3.0:1786400758.224561:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1786400758.224580:0:5781:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1786400758.224617:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1786400758.224669:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1786400758.225993:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1786400758.226017:0:5781:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.108@tcp 20000000:01000000:3.0:1786400758.226019:0:5781:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.108@tcp (null) (null) (null) 00000040:00080000:3.0:1786400758.226052:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1786400758.226060:0:5781:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1786400758.226318:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1786400758.226328:0:5781:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.108@tcp (null) (null) 00000040:00080000:3.0:1786400758.226379:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1786400758.226389:0:5781:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1786400758.226561:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1786400758.226682:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1786400758.226714:0:5781:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1786400758.226717:0:5781:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1786400758.226723:0:5781:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1786400758.226725:0:5781:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1786400758.226727:0:5781:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1786400758.226739:0:5781:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1786400758.226741:0:5781:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1786400758.226774:0:5781:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1786400758.226777:0:5781:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1786400758.230285:0:6603:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1786400758.230373:0:6603:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1786400758.230565:0:6603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1786400758.231013:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1786400758.231055:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1786400758.231268:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1786400758.231285:0:5781:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1786400758.231288:0:5781:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1786400758.231941:0:6604:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:3.0:1786400758.232004:0:6604:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:3.0:1786400758.232054:0:6604:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1786400758.232351:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1786400758.232390:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1786400758.232505:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1786400758.232518:0:5781:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1786400758.232521:0:5781:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1786400758.233134:0:6605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1786400758.233366:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1786400758.233402:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1786400758.233682:0:5781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:1.0:1786400758.233715:0:5781:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1786400758.233736:0:5781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d6fc138e400/0x5ccaaf4f3cb1d6a8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.233754:0:5781:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fc138e800/0x5ccaaf4f3cb1d5c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d5ba expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.233763:0:5781:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fca090600/0x5ccaaf4f3cb1d5dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d5d6 expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.233769:0:5781:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1d64d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d646 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.233777:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d6fc138e400/0x5ccaaf4f3cb1d6a8 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.233826:0:5781:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1d64d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d646 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.233843:0:5781:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1d64d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d646 expref: 12 pid: 5783 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400758.233859:0:5781:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5781:1873176872096640:0@lo:104: 00000100:00100000:1.0:1786400758.233919:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786400758.234036:0:5781:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fca090600/0x5ccaaf4f3cb1d5dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d5d6 expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.234044:0:5781:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fca090600/0x5ccaaf4f3cb1d5dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d5d6 expref: 12 pid: 5780 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400758.234052:0:5781:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5781:1873176872096768:0@lo:104: 00000100:00100000:1.0:1786400758.234075:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786400758.234371:0:5781:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fc138e800/0x5ccaaf4f3cb1d5c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d5ba expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400758.234380:0:5781:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fc138e800/0x5ccaaf4f3cb1d5c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d5ba expref: 12 pid: 5781 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400758.234394:0:5781:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5781:1873176872096896:0@lo:104: 00000100:00100000:2.0:1786400758.234427:0:5781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400758.234558:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872096640 00000100:00100000:3.0:1786400758.234566:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872096640 00000100:00100000:3.0:1786400758.234685:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872096768 00000100:00100000:3.0:1786400758.234689:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872096768 00000100:00100000:3.0:1786400758.234715:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1786400758.234723:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:97b0324f-e214-4822-8711-e150ddac2a7e+4:5781:x1873176872096640:12345-0@lo:104: 00010000:00010000:3.0:1786400758.234734:0:5771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38600/0x5ccaaf4f3cb1d646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d64d expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400758.234791:0:5771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786400758.234798:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:97b0324f-e214-4822-8711-e150ddac2a7e+4:5781:x1873176872096640:12345-0@lo:104: Request processed in 75us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400758.234805:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1786400758.234824:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1786400758.234830:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:97b0324f-e214-4822-8711-e150ddac2a7e+3:5781:x1873176872096768:12345-0@lo:104: 00010000:00010000:3.0:1786400758.234836:0:5771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39000/0x5ccaaf4f3cb1d5d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d5dd expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400758.234870:0:5771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1786400758.234875:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:97b0324f-e214-4822-8711-e150ddac2a7e+3:5781:x1873176872096768:12345-0@lo:104: Request processed in 46us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400758.234881:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1786400758.234899:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786400758.234904:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38600/0x5ccaaf4f3cb1d646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d64d expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400758.234911:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7d38600 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:3.0:1786400758.234915:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38600/0x5ccaaf4f3cb1d646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5ccaaf4f3cb1d64d expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400758.234924:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38600/0x5ccaaf4f3cb1d646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5ccaaf4f3cb1d64d expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786400758.234939:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38600/0x5ccaaf4f3cb1d646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5ccaaf4f3cb1d64d expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400758.234944:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786400758.234971:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38600/0x5ccaaf4f3cb1d646 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d64d expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400758.234978:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786400758.234996:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38600/0x5ccaaf4f3cb1d646 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d64d expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400758.235003:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38600/0x5ccaaf4f3cb1d646 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d64d expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400758.235014:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786400758.235018:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39000/0x5ccaaf4f3cb1d5d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d5dd expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400758.235024:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7d39000 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:3.0:1786400758.235026:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39000/0x5ccaaf4f3cb1d5d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5ccaaf4f3cb1d5dd expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400758.235033:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39000/0x5ccaaf4f3cb1d5d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5ccaaf4f3cb1d5dd expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786400758.235038:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39000/0x5ccaaf4f3cb1d5d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5ccaaf4f3cb1d5dd expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400758.235043:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786400758.235062:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39000/0x5ccaaf4f3cb1d5d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d5dd expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400758.235067:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786400758.235072:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39000/0x5ccaaf4f3cb1d5d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d5dd expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400758.235078:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39000/0x5ccaaf4f3cb1d5d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d5dd expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400758.235116:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400758.235118:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400758.235119:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400758.235139:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872097024:0@lo:103: 00000100:00100000:3.0:1786400758.235169:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400758.235199:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786400758.235205:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872097152:0@lo:103: 00000100:00100000:3.0:1786400758.235223:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400758.235254:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872097024 00000100:00100000:3.0:1786400758.235258:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872097024 00010000:00010000:3.0:1786400758.235275:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1d64d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d646 expref: 13 pid: 5783 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400758.235294:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872097152 00000100:00100000:3.0:1786400758.235297:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872097152 00010000:00010000:3.0:1786400758.235306:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fca090600/0x5ccaaf4f3cb1d5dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d5d6 expref: 14 pid: 5780 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400758.235318:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1786400758.235323:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:97b0324f-e214-4822-8711-e150ddac2a7e+14:3308:x1873176872097024:12345-0@lo:103: 00010000:00010000:3.0:1786400758.235343:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400758.235349:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1d64d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d646 expref: 14 pid: 5783 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400758.235359:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1d64d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d646 expref: 14 pid: 5783 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400758.235374:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400758.235401:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:97b0324f-e214-4822-8711-e150ddac2a7e+14:3308:x1873176872097024:12345-0@lo:103: Request processed in 78us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400758.235408:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1786400758.235439:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1786400758.235445:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:97b0324f-e214-4822-8711-e150ddac2a7e+13:3308:x1873176872097152:12345-0@lo:103: 00010000:00010000:3.0:1786400758.235467:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400758.235472:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fca090600/0x5ccaaf4f3cb1d5dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d5d6 expref: 13 pid: 5780 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400758.235683:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fca090600/0x5ccaaf4f3cb1d5dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d5d6 expref: 13 pid: 5780 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400758.235703:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400758.235728:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:97b0324f-e214-4822-8711-e150ddac2a7e+13:3308:x1873176872097152:12345-0@lo:103: Request processed in 284us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400758.235734:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1786400758.235787:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872097152:0@lo:103: 00000100:00100000:3.0:1786400758.235797:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872097024:0@lo:103: 00010000:00010000:1.0:1786400758.236063:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400758.238357:0:5781:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fff87dc00 going to sleep for 11 seconds 00010000:00010000:2.0:1786400758.238407:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1d64d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d646 expref: 12 pid: 5783 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400758.238437:0:5781:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5781:1873176872096640:0@lo:104: 00010000:00010000:2.0:1786400758.238451:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fca090600/0x5ccaaf4f3cb1d5dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d5d6 expref: 11 pid: 5780 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400758.238465:0:5781:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5781:1873176872096768:0@lo:104: 00000100:00100000:3.0:1786400758.238715:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872096896 00000100:00100000:3.0:1786400758.238724:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872096896 00000100:00100000:3.0:1786400758.238789:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1786400758.238799:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee30d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:97b0324f-e214-4822-8711-e150ddac2a7e+3:5781:x1873176872096896:12345-0@lo:104: 00010000:00010000:3.0:1786400758.238814:0:5771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1d5ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d5c1 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400758.238935:0:5771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786400758.238941:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee30d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:97b0324f-e214-4822-8711-e150ddac2a7e+3:5781:x1873176872096896:12345-0@lo:104: Request processed in 144us (4512us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400758.238948:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1786400758.239000:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786400758.239007:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1d5ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d5c1 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.239015:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7d38000 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:1.0:1786400758.239019:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1d5ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5ccaaf4f3cb1d5c1 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.239027:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1d5ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5ccaaf4f3cb1d5c1 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786400758.239034:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1d5ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5ccaaf4f3cb1d5c1 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400758.239046:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786400758.239116:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1d5ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d5c1 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.239123:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786400758.239149:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1d5ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d5c1 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.239156:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1d5ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d5c1 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.239172:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400758.239174:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400758.239176:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400758.239269:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786400758.239283:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:97b0324f-e214-4822-8711-e150ddac2a7e:3307:1873176872097280:0@lo:103: 00000100:00100000:3.0:1786400758.239318:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400758.239427:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872097280 00000100:00100000:1.0:1786400758.239432:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872097280 00010000:00010000:1.0:1786400758.239452:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fc138e800/0x5ccaaf4f3cb1d5c1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d5ba expref: 11 pid: 5781 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400758.239474:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1786400758.239492:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:97b0324f-e214-4822-8711-e150ddac2a7e+11:3307:x1873176872097280:12345-0@lo:103: 00010000:00010000:1.0:1786400758.239502:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400758.239507:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fc138e800/0x5ccaaf4f3cb1d5c1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d5ba expref: 11 pid: 5781 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.239518:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fc138e800/0x5ccaaf4f3cb1d5c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d5ba expref: 11 pid: 5781 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.239536:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d6fc138e400/0x5ccaaf4f3cb1d6a8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.239550:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc138e400/0x5ccaaf4f3cb1d6a8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.239566:0:5775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fc138e400/0x5ccaaf4f3cb1d6a8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.239573:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fc138e400/0x5ccaaf4f3cb1d6a8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.239580:0:5775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d6fc138e400/0x5ccaaf4f3cb1d6a8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.239778:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d6fc138e400/0x5ccaaf4f3cb1d6a8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.239783:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138e400 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:1.0:1786400758.239787:0:5775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d6fc138e400/0x5ccaaf4f3cb1d6a8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.239795:0:5775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d6fc138e400/0x5ccaaf4f3cb1d6a8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.239804:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d6fc138e400/0x5ccaaf4f3cb1d6a8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.239814:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400758.239857:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:97b0324f-e214-4822-8711-e150ddac2a7e+11:3307:x1873176872097280:12345-0@lo:103: Request processed in 366us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400758.239864:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1786400758.239950:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc138e800/0x5ccaaf4f3cb1d5c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d5ba expref: 10 pid: 5781 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400758.239962:0:5781:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5781:1873176872096896:0@lo:104: 00010000:00010000:2.0:1786400758.239984:0:5781:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d6fc138e400/0x5ccaaf4f3cb1d6a8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400758.239993:0:5781:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d6fc138e400/0x5ccaaf4f3cb1d6a8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400758.240000:0:5781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d6fc138e400/0x5ccaaf4f3cb1d6a8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400758.240003:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:97b0324f-e214-4822-8711-e150ddac2a7e:3307:1873176872097280:0@lo:103: 00010000:00010000:2.0:1786400758.240006:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc138e400/0x5ccaaf4f3cb1d6a8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1786400758.240019:0:5781:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1786400758.291101:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+9:6588:x1873176872096512:12345-0@lo:253: Request processed in 68401us (68844us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400758.291117:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1786400758.291240:0:6588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872096512:0@lo:253: 10000000:01000000:1.0:1786400758.291260:0:6588:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1786400758.291263:0:6588:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1786400758.291265:0:6588:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1786400758.291266:0:6588:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786400758.291267:0:6588:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1786400758.291269:0:6588:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786400758.291270:0:6588:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786400758.291272:0:6588:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786400758.291274:0:6588:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1786400758.291275:0:6588:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786400758.291276:0:6588:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1786400758.291295:0:6588:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d6fc49f0000 from lustre-OST0000 10000000:01000000:1.0:1786400758.291320:0:6588:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1786400758.291323:0:6588:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1786400758.291330:0:6588:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d6fc523cd40 local copy 10000000:01000000:1.0:1786400758.291333:0:6588:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1786400758.291368:0:6588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f800/0x5ccaaf4f3cb1d6af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.291380:0:6588:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f800/0x5ccaaf4f3cb1d6af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.291389:0:6588:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f800/0x5ccaaf4f3cb1d6af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400758.291408:0:6588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872097408:0@lo:101: 00000100:00100000:1.0:1786400758.291854:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400758.291981:0:6588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fff87d600 going to sleep for 11 seconds 00000100:00100000:3.0:1786400758.292168:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872097408 00000100:00100000:3.0:1786400758.292175:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872097408 00000100:00100000:3.0:1786400758.292254:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1786400758.292264:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+9:6588:x1873176872097408:12345-0@lo:101: 00010000:00010000:3.0:1786400758.292277:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400758.292292:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe7d39000/0x5ccaaf4f3cb1d6b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d6af expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400758.292315:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe7d39000/0x5ccaaf4f3cb1d6b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d6af expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400758.292325:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe7d39000/0x5ccaaf4f3cb1d6b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d6af expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400758.292333:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7d39000, rc 0) 00000100:00100000:3.0:1786400758.292378:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+10:6588:x1873176872097408:12345-0@lo:101: Request processed in 115us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400758.292395:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1786400758.292503:0:6588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872097408:0@lo:101: 00010000:00010000:1.0:1786400758.292517:0:6588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f800/0x5ccaaf4f3cb1d6af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5ccaaf4f3cb1d6b6 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.292536:0:6588:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f800/0x5ccaaf4f3cb1d6af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5ccaaf4f3cb1d6b6 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400758.292636:0:6588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872097536:0@lo:501: 00000100:00100000:1.0:1786400758.292663:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400758.292864:0:6588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fff87d600 going to sleep for 11 seconds 00000100:00100000:3.0:1786400758.292903:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872097536 00000100:00100000:3.0:1786400758.292907:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872097536 00000100:00100000:0.0:1786400758.292943:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1786400758.292962:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+10:6588:x1873176872097536:12345-0@lo:501: 00000100:00100000:0.0:1786400758.293195:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+10:6588:x1873176872097536:12345-0@lo:501: Request processed in 244us (531us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786400758.293203:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1786400758.293209:0:6588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872097536:0@lo:501: 10000000:01000000:1.0:1786400758.293220:0:6588:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.108@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1786400758.293247:0:6588:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.108@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1786400758.293252:0:6588:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f800/0x5ccaaf4f3cb1d6af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5ccaaf4f3cb1d6b6 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.293262:0:6588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f800/0x5ccaaf4f3cb1d6af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5ccaaf4f3cb1d6b6 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.293269:0:6588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f800/0x5ccaaf4f3cb1d6af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5ccaaf4f3cb1d6b6 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.293293:0:6588:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1786400758.293310:0:6588:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d6fc49f0000 10000000:01000000:1.0:1786400758.293315:0:6588:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1786400758.293319:0:6588:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9d6fc523cd40 10000000:01000000:1.0:1786400758.293323:0:6588:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1786400758.293326:0:6588:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9d6fc523cd40 from 1 10000000:01000000:1.0:1786400758.293329:0:6588:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1786400758.293350:0:6588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138ec00/0x5ccaaf4f3cb1d6bd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.293367:0:6588:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fc138ec00/0x5ccaaf4f3cb1d6bd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.293376:0:6588:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fc138ec00/0x5ccaaf4f3cb1d6bd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400758.293387:0:6588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872097664:0@lo:101: 00010000:00010000:3.0:1786400758.293504:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786400758.293510:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f800/0x5ccaaf4f3cb1d6af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5ccaaf4f3cb1d6b6 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400758.293517:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138f800 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:3.0:1786400758.293521:0:5776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f800/0x5ccaaf4f3cb1d6af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5ccaaf4f3cb1d6b6 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400758.293528:0:5776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f800/0x5ccaaf4f3cb1d6af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x5ccaaf4f3cb1d6b6 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786400758.293535:0:5776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f800/0x5ccaaf4f3cb1d6af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x5ccaaf4f3cb1d6b6 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400758.293541:0:5776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786400758.293568:0:5776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f800/0x5ccaaf4f3cb1d6af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5ccaaf4f3cb1d6b6 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400758.293575:0:5776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1786400758.293652:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1786400758.293673:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f800/0x5ccaaf4f3cb1d6af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5ccaaf4f3cb1d6b6 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400758.293756:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400758.293779:0:6588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fff87d6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1786400758.293815:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f800/0x5ccaaf4f3cb1d6af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5ccaaf4f3cb1d6b6 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400758.293831:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400758.293833:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400758.293839:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400758.293915:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:97b0324f-e214-4822-8711-e150ddac2a7e:3306:1873176872097792:0@lo:103: 00000100:00100000:2.0:1786400758.293944:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400758.294002:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872097664 00000100:00100000:2.0:1786400758.294006:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872097664 00000100:00100000:2.0:1786400758.294041:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1786400758.294049:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+10:6588:x1873176872097664:12345-0@lo:101: 00010000:00010000:2.0:1786400758.294058:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400758.294071:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fca090600/0x5ccaaf4f3cb1d6c4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d6bd expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400758.294180:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fca090600/0x5ccaaf4f3cb1d6c4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d6bd expref: 11 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400758.294191:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fca090600/0x5ccaaf4f3cb1d6c4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d6bd expref: 11 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400758.294199:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca090600, rc 0) 00000100:00100000:2.0:1786400758.294238:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+11:6588:x1873176872097664:12345-0@lo:101: Request processed in 190us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400758.294244:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1786400758.294319:0:6588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872097664:0@lo:101: 00010000:00010000:1.0:1786400758.294331:0:6588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fc138ec00/0x5ccaaf4f3cb1d6bd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d6c4 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.294339:0:6588:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fc138ec00/0x5ccaaf4f3cb1d6bd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d6c4 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400758.294360:0:6588:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1786400758.294377:0:6588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138ec00/0x5ccaaf4f3cb1d6bd lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d6c4 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.294384:0:6588:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fc138ec00/0x5ccaaf4f3cb1d6bd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d6c4 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400758.294391:0:6588:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1786400758.294396:0:6588:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1786400758.294401:0:6588:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1786400758.294403:0:6588:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1786400758.294428:0:6588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d6cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.294441:0:6588:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d6cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.294450:0:6588:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d6cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400758.294462:0:6588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872097920:0@lo:101: 00000100:00100000:1.0:1786400758.294488:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400758.294549:0:6588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fff87d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786400758.294831:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872097792 00000100:00100000:3.0:1786400758.294837:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872097792 00000100:00100000:3.0:1786400758.294875:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786400758.294882:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee30ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:97b0324f-e214-4822-8711-e150ddac2a7e+11:3306:x1873176872097792:12345-0@lo:103: 00010000:00010000:3.0:1786400758.294891:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400758.294903:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe7d39000/0x5ccaaf4f3cb1d6b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d6af expref: 11 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400758.294916:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400758.294950:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee30ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:97b0324f-e214-4822-8711-e150ddac2a7e+10:3306:x1873176872097792:12345-0@lo:103: Request processed in 68us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400758.294955:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786400758.294982:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:97b0324f-e214-4822-8711-e150ddac2a7e:3306:1873176872097792:0@lo:103: 00000100:00100000:0.0:1786400758.295019:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872097920 00000100:00100000:0.0:1786400758.295024:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872097920 00000100:00100000:0.0:1786400758.295056:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1786400758.295062:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+10:6588:x1873176872097920:12345-0@lo:101: 00010000:00010000:0.0:1786400758.295069:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400758.295078:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fc0031a00/0x5ccaaf4f3cb1d6d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d6cb expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400758.295110:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc0031a00/0x5ccaaf4f3cb1d6d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d6cb expref: 11 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400758.295119:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fc0031a00/0x5ccaaf4f3cb1d6d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d6cb expref: 11 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400758.295125:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc0031a00, rc 0) 00000100:00100000:0.0:1786400758.295153:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+11:6588:x1873176872097920:12345-0@lo:101: Request processed in 91us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400758.295159:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1786400758.295309:0:6588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872097920:0@lo:101: 00010000:00010000:1.0:1786400758.295320:0:6588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d6cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d6d2 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.295327:0:6588:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d6cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d6d2 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400758.295494:0:6588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872098048:0@lo:501: 00000100:00100000:1.0:1786400758.295523:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400758.295551:0:6588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fff87d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786400758.295597:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872098048 00000100:00100000:3.0:1786400758.295601:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872098048 00000100:00100000:3.0:1786400758.295630:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1786400758.295637:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+11:6588:x1873176872098048:12345-0@lo:501: 00000100:00100000:3.0:1786400758.295959:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+11:6588:x1873176872098048:12345-0@lo:501: Request processed in 321us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400758.295966:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1786400758.296035:0:6588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872098048:0@lo:501: 00000100:00100000:1.0:1786400758.296060:0:6588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872098176:0@lo:503: 00000100:00100000:1.0:1786400758.296128:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400758.296143:0:6588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fff87d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786400758.296214:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872098176 00000100:00100000:3.0:1786400758.296219:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872098176 00000100:00100000:3.0:1786400758.296239:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1786400758.296246:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+11:6588:x1873176872098176:12345-0@lo:503: 00000100:00100000:3.0:1786400758.296392:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+11:6588:x1873176872098176:12345-0@lo:503: Request processed in 146us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400758.296399:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1786400758.296556:0:6588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872098176:0@lo:503: 00000040:00080000:1.0:1786400758.296921:0:6588:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1786400758.296981:0:6588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872098304:0@lo:502: 00000100:00100000:1.0:1786400758.297014:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400758.297050:0:6588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fff87d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400758.297118:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872098304 00000100:00100000:0.0:1786400758.297123:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872098304 00000100:00100000:0.0:1786400758.297158:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1786400758.297166:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+12:6588:x1873176872098304:12345-0@lo:502: 00000100:00100000:0.0:1786400758.297322:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+12:6588:x1873176872098304:12345-0@lo:502: Request processed in 156us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400758.297335:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1786400758.297378:0:6588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872098304:0@lo:502: 00000040:00080000:0.0:1786400758.297704:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1786400758.297755:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1786400758.297788:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1786400758.297835:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1786400758.297873:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1786400758.297909:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1786400758.297935:0:6588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872098432:0@lo:502: 00000100:00100000:0.0:1786400758.297976:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400758.298000:0:6588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc35fc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400758.298016:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872098432 00000100:00100000:0.0:1786400758.298020:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872098432 00000100:00100000:0.0:1786400758.298043:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1786400758.298049:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+12:6588:x1873176872098432:12345-0@lo:502: 00000100:00100000:0.0:1786400758.298204:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+12:6588:x1873176872098432:12345-0@lo:502: Request processed in 154us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400758.298212:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1786400758.298252:0:6588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872098432:0@lo:502: 00000040:00080000:0.0:1786400758.298326:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1786400758.298334:0:6588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1786400758.299296:0:6608:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1786400758.299306:0:6608:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1786400758.299314:0:6608:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400758.299317:0:6608:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1786400758.299322:0:6608:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1786400758.299336:0:6608:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9d6fc6550000) 00000020:00000080:1.0:1786400758.299358:0:6608:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1786400758.299364:0:6608:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1786400758.299514:0:6608:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d6fc49f0000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1786400758.299522:0:6608:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1786400758.299528:0:6608:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5ccaaf4f3cb1d6e0 00010000:00010000:0.0:1786400758.306917:0:6608:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1786400758.307480:0:6608:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1786400758.310625:0:6608:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1786400758.311031:0:6608:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1786400758.319029:0:6608:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1786400758.319940:0:6608:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1786400758.321394:0:6608:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1786400758.321406:0:6608:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786400758.321425:0:6608:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786400758.321427:0:6608:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1786400758.321431:0:6608:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786400758.321436:0:6608:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786400758.321437:0:6608:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1786400758.321440:0:6608:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1786400758.321442:0:6608:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1786400758.321493:0:6608:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786400758.321496:0:6608:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786400758.321498:0:6608:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1786400758.321501:0:6608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1786400758.323367:0:6588:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1786400758.323404:0:6588:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1786400758.323524:0:6588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d6cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d6d2 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400758.323538:0:6588:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d6cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d6d2 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786400758.323548:0:6588:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6fc49f0000 from 1 10000000:01000000:2.0:1786400758.323559:0:6588:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1786400758.323597:0:6588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fca091000/0x5ccaaf4f3cb1d6e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400758.323606:0:6588:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fca091000/0x5ccaaf4f3cb1d6e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400758.323618:0:6588:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fca091000/0x5ccaaf4f3cb1d6e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400758.323641:0:6588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872098560:0@lo:101: 00000100:00100000:2.0:1786400758.324542:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400758.324595:0:6588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc38a5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1786400758.326054:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872098560 00000100:00100000:2.0:1786400758.326069:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872098560 00000100:00100000:2.0:1786400758.326146:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1786400758.326155:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+11:6588:x1873176872098560:12345-0@lo:101: 00010000:00010000:2.0:1786400758.326171:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400758.326189:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fca091800/0x5ccaaf4f3cb1d6ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d6e7 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400758.326217:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fca091800/0x5ccaaf4f3cb1d6ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d6e7 expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400758.326229:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fca091800/0x5ccaaf4f3cb1d6ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d6e7 expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400758.326239:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca091800, rc 0) 00000100:00100000:2.0:1786400758.326299:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+12:6588:x1873176872098560:12345-0@lo:101: Request processed in 146us (1760us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400758.326317:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1786400758.326378:0:6588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872098560:0@lo:101: 00010000:00010000:2.0:1786400758.326395:0:6588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fca091000/0x5ccaaf4f3cb1d6e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d6ee expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400758.326405:0:6588:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fca091000/0x5ccaaf4f3cb1d6e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d6ee expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400758.326580:0:6588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872098688:0@lo:501: 00000100:00100000:2.0:1786400758.326614:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400758.326648:0:6588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc38a5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1786400758.329187:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872098688 00000100:00100000:1.0:1786400758.329201:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872098688 00000100:00100000:1.0:1786400758.329259:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1786400758.329268:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+12:6588:x1873176872098688:12345-0@lo:501: 00000100:00100000:1.0:1786400758.329589:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+12:6588:x1873176872098688:12345-0@lo:501: Request processed in 320us (2972us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400758.329597:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1786400758.330575:0:6588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872098688:0@lo:501: 00000100:00100000:2.0:1786400758.330627:0:6588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872098816:0@lo:503: 00000100:00100000:2.0:1786400758.330678:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400758.330800:0:6588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc38a5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1786400758.330904:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872098816 00000100:00100000:0.0:1786400758.330910:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872098816 00000100:00100000:0.0:1786400758.330941:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1786400758.330948:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+12:6588:x1873176872098816:12345-0@lo:503: 00000100:00100000:0.0:1786400758.331206:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+12:6588:x1873176872098816:12345-0@lo:503: Request processed in 257us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400758.331213:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1786400758.331302:0:6588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872098816:0@lo:503: 00000040:00080000:2.0:1786400758.331584:0:6588:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1786400758.331652:0:6588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872098944:0@lo:502: 00000100:00100000:2.0:1786400758.331709:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400758.331738:0:6588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc38a5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1786400758.331913:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872098944 00000100:00100000:0.0:1786400758.331919:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872098944 00000100:00100000:0.0:1786400758.331957:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1786400758.331964:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+12:6588:x1873176872098944:12345-0@lo:502: 00000100:00100000:0.0:1786400758.332144:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+12:6588:x1873176872098944:12345-0@lo:502: Request processed in 180us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400758.332151:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1786400758.332195:0:6588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872098944:0@lo:502: 00000040:00080000:0.0:1786400758.332797:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1786400758.332861:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1786400758.332890:0:6588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872099072:0@lo:502: 00000100:00100000:0.0:1786400758.332930:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400758.332951:0:6588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc4c54840 going to sleep for 11 seconds 00000100:00100000:2.0:1786400758.333026:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872099072 00000100:00100000:2.0:1786400758.333031:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872099072 00000100:00100000:2.0:1786400758.333068:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1786400758.333075:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+12:6588:x1873176872099072:12345-0@lo:502: 00000100:00100000:2.0:1786400758.333227:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+12:6588:x1873176872099072:12345-0@lo:502: Request processed in 152us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400758.333240:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1786400758.333535:0:6588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872099072:0@lo:502: 00000040:00080000:0.0:1786400758.333630:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1786400758.333641:0:6588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1786400758.337006:0:6612:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786400758.337023:0:6612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786400758.337025:0:6612:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1786400758.337032:0:6612:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d6fc49f0000 00000020:00000080:0.0:1786400758.337035:0:6612:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1786400758.337056:0:6612:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786400758.337059:0:6612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786400758.337061:0:6612:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1786400758.337063:0:6612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1786400758.337392:0:6588:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1786400758.337435:0:6588:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1786400758.337460:0:6588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fca091000/0x5ccaaf4f3cb1d6e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d6ee expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400758.337472:0:6588:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fca091000/0x5ccaaf4f3cb1d6e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d6ee expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786400758.337516:0:6588:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1786400758.337519:0:6588:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d6fc49f0000 10000000:01000000:2.0:1786400758.337522:0:6588:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d6fc49f0000 10000000:01000000:2.0:1786400758.337526:0:6588:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1786400758.337533:0:6588:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d6fc49f0000 from 1 10000000:01000000:2.0:1786400758.337535:0:6588:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1786400758.337573:0:6588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fca090e00/0x5ccaaf4f3cb1d6f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400758.337583:0:6588:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fca090e00/0x5ccaaf4f3cb1d6f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400758.337594:0:6588:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fca090e00/0x5ccaaf4f3cb1d6f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400758.337620:0:6588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872099200:0@lo:101: 00000100:00100000:2.0:1786400758.337818:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400758.337868:0:6588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc4abd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786400758.337962:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872099200 00000100:00100000:3.0:1786400758.337969:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872099200 00000100:00100000:3.0:1786400758.338025:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1786400758.338035:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+12:6588:x1873176872099200:12345-0@lo:101: 00010000:00010000:3.0:1786400758.338050:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400758.338063:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe7d39000/0x5ccaaf4f3cb1d6fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d6f5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400758.338119:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe7d39000/0x5ccaaf4f3cb1d6fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d6f5 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400758.338130:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe7d39000/0x5ccaaf4f3cb1d6fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d6f5 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400758.338140:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7d39000, rc 0) 00000100:00100000:3.0:1786400758.338184:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+13:6588:x1873176872099200:12345-0@lo:101: Request processed in 150us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400758.338190:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1786400758.338287:0:6588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872099200:0@lo:101: 00010000:00010000:0.0:1786400758.338302:0:6588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fca090e00/0x5ccaaf4f3cb1d6f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d6fc expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400758.338310:0:6588:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fca090e00/0x5ccaaf4f3cb1d6f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d6fc expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400758.338401:0:6588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872099328:0@lo:501: 00000100:00100000:0.0:1786400758.338507:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400758.338530:0:6588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc8467900 going to sleep for 11 seconds 00000100:00100000:0.0:1786400758.338545:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872099328 00000100:00100000:0.0:1786400758.338549:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872099328 00000100:00100000:0.0:1786400758.338582:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1786400758.338590:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+13:6588:x1873176872099328:12345-0@lo:501: 00000100:00100000:0.0:1786400758.339230:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+13:6588:x1873176872099328:12345-0@lo:501: Request processed in 638us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400758.339238:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1786400758.339274:0:6588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872099328:0@lo:501: 00000100:00100000:0.0:1786400758.339302:0:6588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872099456:0@lo:503: 00000100:00100000:0.0:1786400758.339338:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400758.339357:0:6588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc8467900 going to sleep for 11 seconds 00000100:00100000:0.0:1786400758.339368:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872099456 00000100:00100000:0.0:1786400758.339372:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872099456 00000100:00100000:0.0:1786400758.339388:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1786400758.339394:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+13:6588:x1873176872099456:12345-0@lo:503: 00000100:00100000:0.0:1786400758.339902:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+13:6588:x1873176872099456:12345-0@lo:503: Request processed in 507us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400758.339910:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1786400758.343558:0:6588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872099456:0@lo:503: 00000040:00080000:2.0:1786400758.344545:0:6588:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1786400758.344647:0:6588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872099584:0@lo:502: 00000100:00100000:2.0:1786400758.345150:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400758.345195:0:6588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc4abd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400758.345297:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872099584 00000100:00100000:0.0:1786400758.345305:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872099584 00000100:00100000:0.0:1786400758.345345:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1786400758.345354:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+13:6588:x1873176872099584:12345-0@lo:502: 00000100:00100000:0.0:1786400758.345595:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+13:6588:x1873176872099584:12345-0@lo:502: Request processed in 240us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400758.345603:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1786400758.345845:0:6588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872099584:0@lo:502: 00000040:00080000:1.0:1786400758.346168:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1786400758.346226:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1786400758.346263:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1786400758.346312:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1786400758.346348:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1786400758.346399:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1786400758.346455:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1786400758.346493:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1786400758.346565:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1786400758.346603:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1786400758.346637:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1786400758.346822:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1786400758.346864:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1786400758.346900:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1786400758.346946:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1786400758.346980:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1786400758.347013:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1786400758.347077:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1786400758.347143:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1786400758.347178:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1786400758.347227:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1786400758.347262:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1786400758.347312:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1786400758.347364:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1786400758.347399:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1786400758.347590:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1786400758.347641:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1786400758.347676:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1786400758.347807:0:6588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872099712:0@lo:502: 00000100:00100000:1.0:1786400758.347881:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400758.347924:0:6588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fff87d240 going to sleep for 11 seconds 00000100:00100000:0.0:1786400758.348012:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872099712 00000100:00100000:0.0:1786400758.348019:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872099712 00000100:00100000:0.0:1786400758.348061:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1786400758.348070:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+13:6588:x1873176872099712:12345-0@lo:502: 00000100:00100000:0.0:1786400758.348293:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+13:6588:x1873176872099712:12345-0@lo:502: Request processed in 224us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400758.348306:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1786400758.348632:0:6588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872099712:0@lo:502: 00000040:00080000:1.0:1786400758.349070:0:6588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1786400758.349112:0:6588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1786400758.350640:0:6613:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1786400758.350656:0:6613:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9d6fc5238000) 00000020:00000080:0.0:1786400758.350762:0:6613:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1786400758.350990:0:6613:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d6fc49f0000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1786400758.350995:0:6613:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d6fc49f0000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1786400758.350997:0:6613:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d6fc49f0000 3 00010000:00080000:0.0:1786400758.351025:0:6613:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d6ec470c000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.108@tcp at head 00010000:00010000:0.0:1786400758.353361:0:6613:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1786400758.353536:0:6613:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1786400758.353576:0:6613:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1786400758.353589:0:6613:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5ccaaf4f3cb1d70a 00000100:00080000:0.0:1786400758.353599:0:6613:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1786400758.353605:0:6613:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9d6ec470c000 using connection 192.168.204.108@tcp/0@lo 00000100:00100000:0.0:1786400758.353644:0:6613:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d7000dd7b80 x1873176872099840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786400758.353794:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1873176872099840:0@lo:38: 00000100:00100000:1.0:1786400758.353869:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400758.353993:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872099840 00000100:00100000:2.0:1786400758.354001:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872099840 00000100:00100000:2.0:1786400758.354037:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1786400758.354045:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1873176872099840:12345-0@lo:38: 00010000:00080000:2.0:1786400758.354069:0:5788:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:2.0:1786400758.354134:0:5788:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5ccaaf4f3cb1d711 00000004:00100000:2.0:1786400758.354151:0:5788:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1786400758.354184:0:5788:0:(import.c:65:import_set_state_nolock()) ffff9d6ec507a800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1786400758.354268:0:6613:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1786400758.354335:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873176872099968:0@lo:400: 00000100:00100000:0.0:1786400758.354365:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400758.354406:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1786400758.354428:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1786400758.360585:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1873176872099840:12345-0@lo:38: Request processed in 6528us (6704us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400758.360599:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1786400758.360633:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872099968 00000100:00100000:2.0:1786400758.360642:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872099968 00000100:00100000:2.0:1786400758.360766:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1786400758.360777:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d7000dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873176872099968:12345-0@lo:400: 00000100:00100000:2.0:1786400758.360867:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d7000dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873176872099968:12345-0@lo:400: Request processed in 92us (6501us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400758.360874:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1786400758.360943:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d7000dd7480 x1873176872099968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400758.360958:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873176872099968:0@lo:400: 00010000:00080000:1.0:1786400758.361374:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d7000dd7b80 x1873176872099840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786400768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400758.361397:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1786400758.361406:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1786400758.361496:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1786400758.361503:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1786400758.361506:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9d6ec470c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1786400758.361513:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1873176872099840:0@lo:38: 00000040:00080000:2.0:1786400758.361931:0:6613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1786400758.362532:0:6588:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1786400758.362557:0:6588:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1786400758.362576:0:6588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fca090e00/0x5ccaaf4f3cb1d6f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d6fc expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.362587:0:6588:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fca090e00/0x5ccaaf4f3cb1d6f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d6fc expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1786400758.362639:0:6588:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1786400758.362641:0:6588:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1786400758.362643:0:6588:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786400758.362644:0:6588:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786400758.362645:0:6588:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786400758.362647:0:6588:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786400758.362648:0:6588:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786400758.362649:0:6588:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1786400758.362651:0:6588:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1786400758.362652:0:6588:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786400758.362654:0:6588:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1786400758.362658:0:6588:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1786400758.362660:0:6588:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1786400758.362662:0:6588:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1786400758.362663:0:6588:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786400758.362664:0:6588:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786400758.362665:0:6588:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786400758.362666:0:6588:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786400758.362672:0:6588:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786400758.362673:0:6588:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1786400758.362674:0:6588:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1786400758.362675:0:6588:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786400758.362676:0:6588:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1786400758.362835:0:6588:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1786400758.362853:0:6588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872100096:0@lo:253: 00000100:00100000:1.0:1786400758.362916:0:6588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400758.363044:0:6588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fff87d240 going to sleep for 11 seconds 00000100:00100000:2.0:1786400758.364219:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872100096 00000100:00100000:2.0:1786400758.364231:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872100096 00000100:00100000:2.0:1786400758.364333:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1786400758.364343:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+13:6588:x1873176872100096:12345-0@lo:253: 20000000:01000000:2.0:1786400758.364374:0:5783:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1786400758.364388:0:5783:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1786400758.388176:0:5783:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1786400758.388197:0:5783:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1786400758.388350:0:5804:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1786400758.388355:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1786400758.388379:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d6fc0030800/0x5ccaaf4f3cb1d718 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400758.388398:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fe7d39200/0x5ccaaf4f3cb1d670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d669 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400758.388567:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d6fc0030800/0x5ccaaf4f3cb1d718 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400758.388606:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fe7d39200/0x5ccaaf4f3cb1d670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d669 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400758.388621:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fe7d39200/0x5ccaaf4f3cb1d670 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d669 expref: 13 pid: 5783 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400758.388637:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd5880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5804:1873176872100224:0@lo:104: 00000100:00100000:0.0:1786400758.389224:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400758.389307:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fcbb7c600 going to sleep for 11 seconds 00000100:00100000:3.0:1786400758.391226:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872100224 00000100:00100000:3.0:1786400758.391239:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872100224 00000100:00100000:3.0:1786400758.391315:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1786400758.391324:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d7000dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:97b0324f-e214-4822-8711-e150ddac2a7e+3:5804:x1873176872100224:12345-0@lo:104: 00010000:00010000:3.0:1786400758.391341:0:5771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031000/0x5ccaaf4f3cb1d669 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d670 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400758.391431:0:5771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786400758.391437:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d7000dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:97b0324f-e214-4822-8711-e150ddac2a7e+3:5804:x1873176872100224:12345-0@lo:104: Request processed in 114us (2215us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400758.391458:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1786400758.391549:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400758.391565:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031000/0x5ccaaf4f3cb1d669 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d670 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400758.391573:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc0031000 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:2.0:1786400758.391577:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031000/0x5ccaaf4f3cb1d669 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5ccaaf4f3cb1d670 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400758.391587:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031000/0x5ccaaf4f3cb1d669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5ccaaf4f3cb1d670 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786400758.391595:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031000/0x5ccaaf4f3cb1d669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5ccaaf4f3cb1d670 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786400758.391600:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1786400758.391635:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031000/0x5ccaaf4f3cb1d669 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d670 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400758.391641:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786400758.391657:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031000/0x5ccaaf4f3cb1d669 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d670 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400758.391663:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031000/0x5ccaaf4f3cb1d669 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d670 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400758.391833:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400758.391835:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400758.391843:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400758.391865:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:97b0324f-e214-4822-8711-e150ddac2a7e:3309:1873176872100352:0@lo:103: 00000100:00100000:2.0:1786400758.391909:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400758.392012:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd5880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5804:1873176872100224:0@lo:104: 00010000:00010000:1.0:1786400758.392033:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d6fc0030800/0x5ccaaf4f3cb1d718 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400758.392052:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872100352 00000100:00100000:1.0:1786400758.392055:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872100352 00010000:00010000:1.0:1786400758.392072:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fe7d39200/0x5ccaaf4f3cb1d670 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d669 expref: 14 pid: 5783 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400758.392165:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1786400758.392172:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc458a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:97b0324f-e214-4822-8711-e150ddac2a7e+14:3309:x1873176872100352:12345-0@lo:103: 00010000:00010000:1.0:1786400758.392182:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400758.392187:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fe7d39200/0x5ccaaf4f3cb1d670 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d669 expref: 14 pid: 5783 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.392197:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fe7d39200/0x5ccaaf4f3cb1d670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d669 expref: 14 pid: 5783 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.392210:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe7d39200/0x5ccaaf4f3cb1d670 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d669 expref: 14 pid: 5783 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.392223:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d6fc0030800/0x5ccaaf4f3cb1d718 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.392238:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc0030800/0x5ccaaf4f3cb1d718 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1786400758.392251:0:5774:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003896574s 00010000:00010000:1.0:1786400758.392256:0:5774:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fc0030800/0x5ccaaf4f3cb1d718 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.392264:0:5774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fc0030800/0x5ccaaf4f3cb1d718 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.392271:0:5774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d6fc0030800/0x5ccaaf4f3cb1d718 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.392277:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d6fc0030800/0x5ccaaf4f3cb1d718 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.392282:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc0030800 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:1.0:1786400758.392287:0:5774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d6fc0030800/0x5ccaaf4f3cb1d718 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.392294:0:5774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d6fc0030800/0x5ccaaf4f3cb1d718 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.392306:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d6fc0030800/0x5ccaaf4f3cb1d718 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.392315:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400758.392341:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc458a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:97b0324f-e214-4822-8711-e150ddac2a7e+13:3309:x1873176872100352:12345-0@lo:103: Request processed in 170us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400758.392347:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1786400758.392400:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:97b0324f-e214-4822-8711-e150ddac2a7e:3309:1873176872100352:0@lo:103: 00010000:00010000:1.0:1786400758.392413:0:5804:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d6fc0030800/0x5ccaaf4f3cb1d718 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.392421:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d6fc0030800/0x5ccaaf4f3cb1d718 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400758.392427:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc0030800/0x5ccaaf4f3cb1d718 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400758.401793:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+12:6588:x1873176872100096:12345-0@lo:253: Request processed in 37443us (38866us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400758.401811:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1786400758.401986:0:6588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:6588:1873176872100096:0@lo:253: 10000000:01000000:2.0:1786400758.402002:0:6588:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1786400758.402006:0:6588:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1786400758.402008:0:6588:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1786400758.402009:0:6588:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786400758.402011:0:6588:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786400758.402012:0:6588:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786400758.402013:0:6588:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786400758.402015:0:6588:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1786400758.402016:0:6588:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1786400758.402018:0:6588:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1786400758.402020:0:6588:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786400758.402021:0:6588:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1786400758.402035:0:6588:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1786400758.410061:0:6588:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1786400758.410374:0:6588:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1786400758.410667:0:6588:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1786400758.411010:0:6588:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1786400758.411294:0:6588:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1786400758.411804:0:6588:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1786400758.413175:0:6588:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1786400758.658765:0:6588:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1786400758.658773:0:6588:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1786400758.658806:0:6588:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1786400758.658872:0:6588:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.108@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1786400758.658887:0:6588:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1786400758.658914:0:6588:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1786400758.702923:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400759.726924:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400760.751804:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400761.776232:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400762.801299:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400763.632442:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873176872100608:0@lo:400: 00000100:00100000:1.0:1786400763.632518:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400763.632573:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786400763.632580:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:97b0324f-e214-4822-8711-e150ddac2a7e:3307:1873176872100480:0@lo:400: 00000100:00100000:1.0:1786400763.632622:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400763.632648:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873176872100736:0@lo:400: 00000100:00100000:1.0:1786400763.632670:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400763.632710:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872100608 00000100:00100000:1.0:1786400763.632717:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872100608 00000100:00100000:1.0:1786400763.632771:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872100736 00000100:00100000:1.0:1786400763.632774:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872100736 00000100:00100000:1.0:1786400763.632807:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1786400763.632817:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873176872100608:12345-0@lo:400: 00000100:00100000:1.0:1786400763.632884:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873176872100608:12345-0@lo:400: Request processed in 68us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400763.632892:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1786400763.632921:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1786400763.632927:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873176872100736:12345-0@lo:400: 00000100:00100000:1.0:1786400763.632958:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873176872100736:12345-0@lo:400: Request processed in 32us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400763.632964:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1786400763.632979:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872100480 00000100:00100000:1.0:1786400763.632983:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872100480 00000100:00100000:1.0:1786400763.633004:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1786400763.633009:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+12:3307:x1873176872100480:12345-0@lo:400: 00000100:00100000:1.0:1786400763.633035:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+12:3307:x1873176872100480:12345-0@lo:400: Request processed in 25us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400763.633040:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1786400763.633112:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6fc97f7b80 x1873176872100736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400763.633126:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873176872100736:0@lo:400: 00000100:00100000:1.0:1786400763.633151:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:97b0324f-e214-4822-8711-e150ddac2a7e:3307:1873176872100480:0@lo:400: 00010000:00080000:1.0:1786400763.633161:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6fc97f6300 x1873176872100608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400763.633169:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873176872100608:0@lo:400: 00000100:00080000:1.0:1786400763.633207:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1786400763.824812:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400764.846550:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1786400765.002077:0:6959:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg408-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:2.0:1786400765.167210:0:5785:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1786400765.167218:0:5785:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d6fc307d800 from 21 10000000:01000000:2.0:1786400765.167224:0:5785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1786400765.167269:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fca091400/0x5ccaaf4f3cb1d71f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400765.167281:0:5785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fca091400/0x5ccaaf4f3cb1d71f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400765.167292:0:5785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fca091400/0x5ccaaf4f3cb1d71f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400765.167313:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872100864:0@lo:101: 00000100:00100000:2.0:1786400765.168053:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400765.168137:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc4abd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786400765.168224:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872100864 00000100:00100000:3.0:1786400765.168232:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872100864 00000100:00100000:3.0:1786400765.168292:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1786400765.168301:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+12:5785:x1873176872100864:12345-0@lo:101: 00010000:00010000:3.0:1786400765.168317:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400765.168333:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe7d38600/0x5ccaaf4f3cb1d726 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d71f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400765.168357:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe7d38600/0x5ccaaf4f3cb1d726 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d71f expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400765.169432:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe7d38600/0x5ccaaf4f3cb1d726 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d71f expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400765.169443:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7d38600, rc 0) 00000100:00100000:3.0:1786400765.169525:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+13:5785:x1873176872100864:12345-0@lo:101: Request processed in 1224us (1473us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400765.169532:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1786400765.169648:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872100864:0@lo:101: 00010000:00010000:2.0:1786400765.169666:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fca091400/0x5ccaaf4f3cb1d71f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d726 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400765.169675:0:5785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fca091400/0x5ccaaf4f3cb1d71f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d726 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400765.169740:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872100992:0@lo:501: 00000100:00100000:2.0:1786400765.169769:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400765.169804:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc4abd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400765.170163:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872100992 00000100:00100000:0.0:1786400765.170169:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872100992 00000100:00100000:0.0:1786400765.170202:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1786400765.170211:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+13:5785:x1873176872100992:12345-0@lo:501: 00000100:00100000:0.0:1786400765.170591:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+13:5785:x1873176872100992:12345-0@lo:501: Request processed in 379us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400765.170598:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1786400765.171152:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872100992:0@lo:501: 00000100:00100000:2.0:1786400765.171189:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872101120:0@lo:503: 00000100:00100000:2.0:1786400765.171232:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400765.171261:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc4abd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400765.171658:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872101120 00000100:00100000:0.0:1786400765.171664:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872101120 00000100:00100000:0.0:1786400765.171705:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1786400765.171713:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+13:5785:x1873176872101120:12345-0@lo:503: 00000100:00100000:0.0:1786400765.172017:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+13:5785:x1873176872101120:12345-0@lo:503: Request processed in 303us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400765.172024:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1786400765.172194:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872101120:0@lo:503: 00000100:00100000:1.0:1786400765.173382:0:6970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:6970:1873176872101248:0@lo:502: 00000100:00100000:1.0:1786400765.173434:0:6970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400765.173480:0:6970:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fff87d240 going to sleep for 11 seconds 00000100:00100000:0.0:1786400765.174326:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872101248 00000100:00100000:0.0:1786400765.174335:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872101248 00000100:00100000:0.0:1786400765.174381:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1786400765.174390:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+13:6970:x1873176872101248:12345-0@lo:502: 00000100:00100000:0.0:1786400765.174976:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+13:6970:x1873176872101248:12345-0@lo:502: Request processed in 584us (1539us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400765.174985:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1786400765.175723:0:6970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:6970:1873176872101248:0@lo:502: 00000100:00100000:1.0:1786400765.175789:0:6970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:6970:1873176872101376:0@lo:502: 00000100:00100000:1.0:1786400765.175834:0:6970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400765.175875:0:6970:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fff87d240 going to sleep for 11 seconds 00000100:00100000:0.0:1786400765.176068:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872101376 00000100:00100000:0.0:1786400765.176074:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872101376 00000100:00100000:0.0:1786400765.176241:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1786400765.176251:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+13:6970:x1873176872101376:12345-0@lo:502: 00000100:00100000:0.0:1786400765.176655:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+13:6970:x1873176872101376:12345-0@lo:502: Request processed in 404us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400765.176662:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1786400765.176770:0:6970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:6970:1873176872101376:0@lo:502: 00000040:00080000:1.0:1786400765.176792:0:6970:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1786400765.176848:0:5785:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1786400765.176865:0:5785:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1786400765.176876:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fca091400/0x5ccaaf4f3cb1d71f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d726 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400765.176886:0:5785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fca091400/0x5ccaaf4f3cb1d71f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d726 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400765.176896:0:5785:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1786400765.176898:0:5785:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9d6fc307d800 from 4 10000000:01000000:1.0:1786400765.176900:0:5785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1786400765.176926:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e600/0x5ccaaf4f3cb1d72d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400765.176933:0:5785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e600/0x5ccaaf4f3cb1d72d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400765.176941:0:5785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e600/0x5ccaaf4f3cb1d72d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400765.176955:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872101504:0@lo:101: 00000100:00100000:1.0:1786400765.176983:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400765.177127:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fff87d240 going to sleep for 11 seconds 00000100:00100000:3.0:1786400765.177320:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872101504 00000100:00100000:3.0:1786400765.177326:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872101504 00000100:00100000:3.0:1786400765.177456:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1786400765.177464:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+13:5785:x1873176872101504:12345-0@lo:101: 00010000:00010000:3.0:1786400765.177542:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400765.177570:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe7d39800/0x5ccaaf4f3cb1d734 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d72d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400765.177595:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe7d39800/0x5ccaaf4f3cb1d734 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d72d expref: 14 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400765.177607:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe7d39800/0x5ccaaf4f3cb1d734 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d72d expref: 14 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400765.177618:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7d39800, rc 0) 00000100:00100000:3.0:1786400765.177742:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+14:5785:x1873176872101504:12345-0@lo:101: Request processed in 277us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400765.177749:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1786400765.177866:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872101504:0@lo:101: 00010000:00010000:1.0:1786400765.177880:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e600/0x5ccaaf4f3cb1d72d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d734 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400765.177889:0:5785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e600/0x5ccaaf4f3cb1d72d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d734 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400765.177935:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872101632:0@lo:256: 00000100:00100000:1.0:1786400765.177965:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400765.178023:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fff87d240 going to sleep for 11 seconds 00000100:00100000:3.0:1786400765.178053:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872101632 00000100:00100000:3.0:1786400765.178057:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872101632 00000100:00100000:3.0:1786400765.178143:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1786400765.178158:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+14:5785:x1873176872101632:12345-0@lo:256: 20000000:01000000:3.0:1786400765.178171:0:5780:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1786400765.178186:0:5780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1786400765.178189:0:5780:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1786400765.178262:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+14:5785:x1873176872101632:12345-0@lo:256: Request processed in 105us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400765.178269:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1786400765.178451:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872101632:0@lo:256: 10000000:01000000:1.0:1786400765.178869:0:5785:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1786400765.178877:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e600/0x5ccaaf4f3cb1d72d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d734 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400765.178886:0:5785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e600/0x5ccaaf4f3cb1d72d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d734 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400765.178893:0:5785:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1786400765.178895:0:5785:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1786400765.178898:0:5785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1786400765.178919:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f000/0x5ccaaf4f3cb1d73b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400765.178926:0:5785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f000/0x5ccaaf4f3cb1d73b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400765.178934:0:5785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f000/0x5ccaaf4f3cb1d73b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400765.178954:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872101760:0@lo:101: 00000100:00100000:1.0:1786400765.178986:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400765.184817:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fff87d240 going to sleep for 11 seconds 00000100:00100000:0.0:1786400765.184935:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872101760 00000100:00100000:0.0:1786400765.184943:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872101760 00000100:00100000:0.0:1786400765.185048:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1786400765.185058:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+14:5785:x1873176872101760:12345-0@lo:101: 00010000:00010000:0.0:1786400765.185073:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400765.185134:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fc0030800/0x5ccaaf4f3cb1d742 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d73b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400765.185161:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc0030800/0x5ccaaf4f3cb1d742 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d73b expref: 15 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400765.185173:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fc0030800/0x5ccaaf4f3cb1d742 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d73b expref: 15 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400765.185182:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc0030800, rc 0) 00000100:00100000:0.0:1786400765.185255:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+15:5785:x1873176872101760:12345-0@lo:101: Request processed in 198us (6267us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400765.185262:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1786400765.185466:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872101760:0@lo:101: 00010000:00010000:1.0:1786400765.185589:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f000/0x5ccaaf4f3cb1d73b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d742 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400765.185599:0:5785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f000/0x5ccaaf4f3cb1d73b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d742 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400765.185664:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872101888:0@lo:501: 00000100:00100000:1.0:1786400765.185700:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400765.185730:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fff87d240 going to sleep for 11 seconds 00000100:00100000:0.0:1786400765.185775:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872101888 00000100:00100000:0.0:1786400765.185780:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872101888 00000100:00100000:0.0:1786400765.185799:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1786400765.185805:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+15:5785:x1873176872101888:12345-0@lo:501: 00000100:00100000:0.0:1786400765.186308:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+15:5785:x1873176872101888:12345-0@lo:501: Request processed in 501us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400765.186316:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1786400765.189246:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872101888:0@lo:501: 00000100:00100000:1.0:1786400765.189311:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872102016:0@lo:503: 00000100:00100000:1.0:1786400765.189826:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400765.189865:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fff87d240 going to sleep for 11 seconds 00000100:00100000:0.0:1786400765.191693:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872102016 00000100:00100000:0.0:1786400765.191710:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872102016 00000100:00100000:0.0:1786400765.191773:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1786400765.191784:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+15:5785:x1873176872102016:12345-0@lo:503: 00000100:00100000:0.0:1786400765.192206:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+15:5785:x1873176872102016:12345-0@lo:503: Request processed in 423us (2379us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400765.192215:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1786400765.192280:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872102016:0@lo:503: 00000100:00100000:0.0:1786400765.192685:0:6972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:6972:1873176872102144:0@lo:502: 00000100:00100000:0.0:1786400765.192731:0:6972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400765.192758:0:6972:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc8624d80 going to sleep for 11 seconds 00000100:00100000:3.0:1786400765.193184:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872102144 00000100:00100000:3.0:1786400765.193192:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872102144 00000100:00100000:3.0:1786400765.193241:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1786400765.193250:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+15:6972:x1873176872102144:12345-0@lo:502: 00000100:00100000:3.0:1786400765.193739:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+15:6972:x1873176872102144:12345-0@lo:502: Request processed in 489us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400765.193746:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1786400765.194193:0:6972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:6972:1873176872102144:0@lo:502: 00000020:01000000:0.0:1786400765.194223:0:6972:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1786400765.194231:0:6972:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1786400765.194237:0:6972:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786400765.194240:0:6972:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1786400765.194246:0:6972:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1786400765.194258:0:6972:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.108@tcp to nid 0x20000c0a8cc6c (192.168.204.108@tcp) 00000020:01000000:0.0:1786400765.194282:0:6972:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1786400765.194285:0:6972:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1786400765.194308:0:6972:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9d6fc33f4d40) 00000020:00000080:0.0:1786400765.194327:0:6972:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1786400765.195293:0:6972:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1786400765.195585:0:6972:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1786400765.195591:0:6972:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:0.0:1786400765.195600:0:6972:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5ccaaf4f3cb1d750 00010000:00080000:0.0:1786400765.195634:0:6972:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d6fc849d000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.108@tcp at head 00010000:00010000:0.0:1786400765.195859:0:6972:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1786400765.273204:0:6972:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1786400765.273224:0:6972:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1786400765.276339:0:6972:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1786400765.276963:0:6972:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1786400765.277017:0:6972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1786400765.277078:0:6972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1786400765.288156:0:6978:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786400765.288164:0:6978:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1786400765.292041:0:6972:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1786400765.292057:0:6972:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1786400765.292894:0:6972:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1786400765.292922:0:6972:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5ccaaf4f3cb1d757 00000100:00080000:0.0:1786400765.292935:0:6972:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1786400765.292942:0:6972:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d6fc849d000 using connection 192.168.204.108@tcp/0@lo 00000100:00100000:0.0:1786400765.292979:0:6972:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d7000dd5180 x1873176872102272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786400765.293013:0:6972:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1786400765.293467:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873176872102272:0@lo:8: 00000100:00100000:3.0:1786400765.293693:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400765.293973:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872102272 00000100:00100000:2.0:1786400765.293981:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872102272 00000020:01000000:0.0:1786400765.294107:0:6972:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786400765.294115:0:6972:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786400765.294118:0:6972:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1786400765.294121:0:6972:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786400765.294124:0:6972:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786400765.294126:0:6972:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1786400765.294129:0:6972:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1786400765.294131:0:6972:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1786400765.294174:0:6972:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:6972:1873176872102400:0@lo:502: 00000100:00100000:0.0:1786400765.294222:0:6972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400765.294238:0:6972:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc8624e40 going to sleep for 11 seconds 00000100:00100000:2.0:1786400765.294495:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786400765.294503:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1873176872102272:12345-0@lo:8: 00010000:00080000:2.0:1786400765.294531:0:6590:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:2.0:1786400765.294573:0:6590:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5ccaaf4f3cb1d75e 00002000:00100000:2.0:1786400765.294620:0:6590:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9d6ec507e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1786400765.294627:0:6590:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000100:00100000:1.0:1786400765.294628:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873176872102528:0@lo:400: 00000001:00000004:2.0:1786400765.294631:0:6590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1786400765.294679:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400765.294717:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872102656:0@lo:400: 00000100:00100000:1.0:1786400765.294757:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00100000:2.0:1786400765.294785:0:6590:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1786400765.294809:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872102528 00000100:00100000:1.0:1786400765.294814:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872102528 00000100:00100000:1.0:1786400765.295074:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872102656 00000100:00100000:1.0:1786400765.295078:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872102656 00000100:00100000:1.0:1786400765.295131:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1786400765.295139:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873176872102528:12345-0@lo:400: 00000100:00100000:3.0:1786400765.295176:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872102400 00000100:00100000:3.0:1786400765.295182:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872102400 00000100:00100000:1.0:1786400765.295197:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873176872102528:12345-0@lo:400: Request processed in 58us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400765.295205:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1786400765.295218:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1786400765.295229:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1786400765.295230:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+15:6972:x1873176872102400:12345-0@lo:502: 00000100:00100000:1.0:1786400765.295241:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872102656:12345-0@lo:400: 00000100:00100000:1.0:1786400765.295274:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872102656:12345-0@lo:400: Request processed in 37us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400765.295280:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1786400765.295303:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1786400765.295414:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6fc97f7480 x1873176872102528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400765.295427:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873176872102528:0@lo:400: 00010000:00080000:1.0:1786400765.295460:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6fc97f7b80 x1873176872102656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400765.295470:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872102656:0@lo:400: 00000100:00100000:3.0:1786400765.295816:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+15:6972:x1873176872102400:12345-0@lo:502: Request processed in 588us (1592us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400765.295824:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1786400765.295888:0:6972:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:6972:1873176872102400:0@lo:502: 00000020:01000000:3.0:1786400765.295914:0:6972:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786400765.295921:0:6972:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786400765.295923:0:6972:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1786400765.295933:0:6972:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1786400765.296231:0:5785:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1786400765.296249:0:5785:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1786400765.296259:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f000/0x5ccaaf4f3cb1d73b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d742 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400765.296269:0:5785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f000/0x5ccaaf4f3cb1d73b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d742 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786400765.296288:0:5785:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1786400765.296290:0:5785:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9d6fc523cd40 from 1 10000000:01000000:0.0:1786400765.296292:0:5785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1786400765.296320:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031000/0x5ccaaf4f3cb1d765 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400765.296327:0:5785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031000/0x5ccaaf4f3cb1d765 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400765.296346:0:5785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031000/0x5ccaaf4f3cb1d765 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400765.296364:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872102784:0@lo:101: 00000100:00100000:0.0:1786400765.296397:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400765.296435:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc302bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1786400765.296667:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872102784 00000100:00100000:3.0:1786400765.296673:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872102784 00000100:00100000:3.0:1786400765.296714:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1786400765.296723:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+15:5785:x1873176872102784:12345-0@lo:101: 00010000:00010000:3.0:1786400765.296734:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400765.296747:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1d76c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d765 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400765.296770:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1d76c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d765 expref: 16 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400765.296783:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1d76c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d765 expref: 16 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400765.296793:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7d38400, rc 0) 00000100:00100000:3.0:1786400765.297159:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+16:5785:x1873176872102784:12345-0@lo:101: Request processed in 435us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400765.297166:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1786400765.297205:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872102784:0@lo:101: 00010000:00010000:3.0:1786400765.297221:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031000/0x5ccaaf4f3cb1d765 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d76c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400765.297230:0:5785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031000/0x5ccaaf4f3cb1d765 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d76c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400765.297293:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872102912:0@lo:501: 00000100:00100000:3.0:1786400765.297321:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400765.297433:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872102912 00000100:00100000:0.0:1786400765.297438:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872102912 00000100:00100000:0.0:1786400765.297469:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1786400765.297477:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+16:5785:x1873176872102912:12345-0@lo:501: 00002000:00080000:2.0:1786400765.297852:0:6590:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1786400765.297886:0:6590:0:(import.c:65:import_set_state_nolock()) ffff9d6ec507b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786400765.298212:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+16:5785:x1873176872102912:12345-0@lo:501: Request processed in 735us (889us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786400765.298222:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1786400765.298453:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1873176872102272:12345-0@lo:8: Request processed in 3949us (4760us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400765.298462:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1786400765.298544:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d7000dd5180 x1873176872102272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1786400775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400765.298564:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1786400765.298574:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1786400765.298582:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1786400765.298586:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1786400765.298589:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9d6fc849d000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1786400765.298641:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1786400765.298646:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873176872102272:0@lo:8: 00000004:00080000:0.0:1786400765.298672:0:6978:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1786400765.298786:0:6978:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 217699698867ns, next at 0ns, rc = 0 00000100:00100000:3.0:1786400765.298927:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d7000d5d480 going to sleep for 11 seconds 00000100:00100000:3.0:1786400765.298947:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872102912:0@lo:501: 10000000:01000000:3.0:1786400765.298972:0:5785:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1786400765.298981:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031000/0x5ccaaf4f3cb1d765 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d76c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400765.298990:0:5785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031000/0x5ccaaf4f3cb1d765 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d76c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786400765.349225:0:5810:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1786400765.388796:0:6979:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1786400765.388843:0:6979:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6979:1873176872103168:0@lo:7: 00000100:00100000:2.0:1786400765.388918:0:6979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400765.388970:0:6979:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc4abde40 going to sleep for 11 seconds 00000100:00100000:2.0:1786400765.388987:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872103040:0@lo:13: 00000100:00100000:2.0:1786400765.389013:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400765.389054:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872103168 00000100:00100000:2.0:1786400765.389061:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872103168 00000100:00100000:2.0:1786400765.389188:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786400765.389198:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee30c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6979:x1873176872103168:12345-0@lo:7: 00000100:00080000:0.0:1786400765.391052:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786400765.391082:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872103040 00000100:00100000:0.0:1786400765.391128:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872103040 00000100:00100000:1.0:1786400765.391230:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786400765.391241:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee30c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1873176872103040:12345-0@lo:13: 00002000:00000024:1.0:1786400765.391283:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1786400765.391375:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee30c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1873176872103040:12345-0@lo:13: Request processed in 135us (2359us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400765.391382:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1786400765.391451:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6fee30ea00 x1873176872103040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400781 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400765.391472:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872103040:0@lo:13: 00002000:00080000:2.0:1786400765.399757:0:6593:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1786400765.399766:0:6593:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1786400765.400006:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee30c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6979:x1873176872103168:12345-0@lo:7: Request processed in 10805us (11083us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400765.400019:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1786400765.400169:0:6979:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6fee30ed80 x1873176872103168/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1786400781 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400765.400186:0:6979:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6979:1873176872103168:0@lo:7: 00000004:00080000:3.0:1786400765.400202:0:6979:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1786400765.400246:0:6979:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6979:1873176872103296:0@lo:5: 00000100:00100000:3.0:1786400765.402749:0:6979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400765.402899:0:6979:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd0bebe40 going to sleep for 11 seconds 00000100:00100000:2.0:1786400765.404125:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872103296 00000100:00100000:2.0:1786400765.404138:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872103296 00000100:00100000:2.0:1786400765.404198:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1786400765.404209:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6979:x1873176872103296:12345-0@lo:5: 00002000:00080000:2.0:1786400765.404241:0:6590:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1786400765.404245:0:6590:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1786400765.404881:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6979:x1873176872103296:12345-0@lo:5: Request processed in 672us (2137us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1786400765.404889:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1786400765.404950:0:6979:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6ff692d500 x1873176872103296/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1786400781 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400765.404967:0:6979:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6979:1873176872103296:0@lo:5: 00000004:00080000:2.0:1786400765.404980:0:6979:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1786400765.405016:0:6979:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6979:1873176872103424:0@lo:700: 00000100:00100000:2.0:1786400765.405048:0:6979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400765.405068:0:6979:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc4abd780 going to sleep for 11 seconds 00000100:00100000:2.0:1786400765.405109:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872103424 00000100:00100000:2.0:1786400765.405112:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872103424 00000100:00100000:2.0:1786400765.405146:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786400765.405154:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee30f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6979:x1873176872103424:12345-0@lo:700: 00000100:00100000:2.0:1786400765.405183:0:6599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30e300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6599:1873176872103552:0@lo:700: 00000100:00100000:2.0:1786400765.405213:0:6599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400765.405232:0:6599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc4abde40 going to sleep for 11 seconds 00000100:00100000:2.0:1786400765.405250:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872103552 00000100:00100000:2.0:1786400765.405253:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872103552 00000100:00100000:2.0:1786400765.405280:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786400765.405287:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee30d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6599:x1873176872103552:12345-0@lo:700: 40000000:02000000:2.0:1786400765.484283:0:5795:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1786400765.495365:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee30d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6599:x1873176872103552:12345-0@lo:700: Request processed in 90070us (90143us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400765.495389:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1786400765.495637:0:6599:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6fee30e300 x1873176872103552/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1786400781 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400765.495733:0:6599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30e300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6599:1873176872103552:0@lo:700: 40000000:02000000:2.0:1786400765.495749:0:6599:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:3.0:1786400765.637280:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee30f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6979:x1873176872103424:12345-0@lo:700: Request processed in 232101us (232205us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400765.637304:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:3.0:1786400765.637341:0:6619:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1786400765.637354:0:6619:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:3.0:1786400765.637393:0:6979:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6fee30fb80 x1873176872103424/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1786400781 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400765.637408:0:6979:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6979:1873176872103424:0@lo:700: 00000004:02000040:3.0:1786400765.692073:0:6979:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1786400765.701151:0:6979:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6979:1873176872103680:0@lo:5: 00000100:00100000:3.0:1786400765.701224:0:6979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400765.701337:0:6979:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd0bebd80 going to sleep for 11 seconds 00000100:00100000:2.0:1786400765.701815:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872103680 00000100:00100000:2.0:1786400765.701825:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872103680 00000100:00100000:2.0:1786400765.702058:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1786400765.702069:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6979:x1873176872103680:12345-0@lo:5: 00002000:00080000:2.0:1786400765.719890:0:6593:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1786400765.719912:0:6593:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1786400765.733581:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6979:x1873176872103680:12345-0@lo:5: Request processed in 31505us (32348us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1786400765.733596:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1786400765.734776:0:6979:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6ff692ce00 x1873176872103680/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1786400781 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400765.734793:0:6979:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1786400765.734809:0:6979:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9d6ff692ce00 x1873176872103680/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1786400781 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400765.734821:0:6979:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6979:1873176872103680:0@lo:5: 00000004:00080000:0.0:1786400765.734846:0:6979:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1786400765.873958:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400766.896392:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400767.918833:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400768.950442:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400769.968632:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1786400770.217921:0:6619:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:0.0:1786400770.798878:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872103808:0@lo:13: 00000100:00100000:0.0:1786400770.798950:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400770.799908:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872103808 00000100:00100000:3.0:1786400770.799919:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872103808 00000100:00100000:3.0:1786400770.799976:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1786400770.799985:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d7000dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872103808:12345-0@lo:13: 00002000:00000024:3.0:1786400770.800021:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786400770.800077:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d7000dd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872103808:12345-0@lo:13: Request processed in 93us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400770.800107:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1786400770.800130:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1786400770.800162:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6fee30e300 x1873176872103808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400786 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400770.800179:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1786400770.800200:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872103808:0@lo:13: 00000100:00100000:1.0:1786400770.806378:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872104064:0@lo:400: 00000100:00100000:1.0:1786400770.806462:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400770.806501:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786400770.806507:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872104192:0@lo:400: 00000100:00100000:1.0:1786400770.806529:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400770.806559:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872104064 00000100:00100000:1.0:1786400770.806567:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872104064 00000100:00100000:1.0:1786400770.806609:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872104192 00000100:00100000:1.0:1786400770.806613:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872104192 00000100:00100000:1.0:1786400770.806646:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1786400770.806654:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872104064:12345-0@lo:400: 00000100:00100000:1.0:1786400770.806719:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872104064:12345-0@lo:400: Request processed in 52us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400770.806726:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1786400770.806745:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1786400770.806751:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872104192:12345-0@lo:400: 00000100:00100000:1.0:1786400770.806775:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872104192:12345-0@lo:400: Request processed in 25us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400770.806781:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1786400770.806821:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6fc97f4e00 x1873176872104192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400770.806834:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872104192:0@lo:400: 00010000:00080000:1.0:1786400770.806843:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6fc97f7480 x1873176872104064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400770.806871:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872104064:0@lo:400: 00000100:00080000:1.0:1786400770.806892:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400770.808048:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786400770.808070:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872103936:0@lo:400: 00000100:00100000:3.0:1786400770.808155:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400770.808220:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872103936 00000100:00100000:3.0:1786400770.808226:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872103936 00000100:00100000:3.0:1786400770.808275:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1786400770.808283:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+16:3308:x1873176872103936:12345-0@lo:400: 00000100:00100000:3.0:1786400770.808328:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+16:3308:x1873176872103936:12345-0@lo:400: Request processed in 46us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400770.808334:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1786400770.808380:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872103936:0@lo:400: 00010000:00010000:1.0:1786400770.992596:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400772.014341:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400773.038255:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400774.064479:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400775.086383:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1786400775.858130:0:7483:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1786400775.858135:0:7483:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1786400775.858264:0:7483:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9d6ec470a000 00000020:01000004:0.0:1786400775.858280:0:7483:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1786400775.858292:0:7483:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1786400775.858305:0:7483:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9d6fc33f3380) 00000020:00000080:0.0:1786400775.858321:0:7483:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1786400775.880034:0:7483:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1786400775.881688:0:7483:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1786400775.914978:0:7483:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00000100:00100000:2.0:1786400775.921483:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872104320:0@lo:400: 00000100:00100000:2.0:1786400775.921559:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400775.921618:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786400775.921624:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873176872104448:0@lo:400: 00000100:00100000:2.0:1786400775.921650:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400775.921678:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872104576:0@lo:400: 00000100:00100000:2.0:1786400775.921699:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400775.921715:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786400775.921719:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872104704:0@lo:400: 00000100:00100000:2.0:1786400775.921741:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400775.921772:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872104320 00000100:00100000:2.0:1786400775.921780:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872104320 00000100:00100000:2.0:1786400775.921828:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1786400775.921837:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+16:3308:x1873176872104320:12345-0@lo:400: 00000100:00100000:2.0:1786400775.921888:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+16:3308:x1873176872104320:12345-0@lo:400: Request processed in 51us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400775.921895:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1786400775.921927:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872104448 00000100:00100000:2.0:1786400775.921935:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872104448 00000100:00100000:2.0:1786400775.921972:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872104576 00000100:00100000:2.0:1786400775.921976:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872104576 00000100:00100000:2.0:1786400775.922023:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1786400775.922029:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee30ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873176872104448:12345-0@lo:400: 00000100:00100000:2.0:1786400775.922059:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee30ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873176872104448:12345-0@lo:400: Request processed in 31us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400775.922065:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1786400775.922076:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1786400775.922082:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee30ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872104576:12345-0@lo:400: 00000100:00100000:2.0:1786400775.922138:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee30ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872104576:12345-0@lo:400: Request processed in 55us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400775.922144:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1786400775.922164:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872104704 00000100:00100000:2.0:1786400775.922167:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872104704 00000100:00100000:2.0:1786400775.922193:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786400775.922199:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee30df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872104704:12345-0@lo:400: 00000100:00100000:2.0:1786400775.922228:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee30df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872104704:12345-0@lo:400: Request processed in 29us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400775.922234:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1786400775.922270:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6fee30d180 x1873176872104448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400775.922289:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873176872104448:0@lo:400: 00000100:00100000:2.0:1786400775.922300:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872104320:0@lo:400: 00000100:00080000:2.0:1786400775.922325:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786400775.922330:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1786400775.922354:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6fee30fb80 x1873176872104704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400775.922374:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872104704:0@lo:400: 00010000:00080000:2.0:1786400775.922384:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6fee30e300 x1873176872104576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400775.922391:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872104576:0@lo:400: 00000100:00100000:1.0:1786400775.923889:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786400775.923915:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872104832:0@lo:13: 00000100:00100000:1.0:1786400775.923984:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400775.924196:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872104832 00000100:00100000:3.0:1786400775.924204:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872104832 00000100:00100000:3.0:1786400775.924295:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1786400775.924306:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872104832:12345-0@lo:13: 00002000:00000024:3.0:1786400775.924337:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786400775.924397:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872104832:12345-0@lo:13: Request processed in 93us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400775.924404:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1786400775.926563:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6fc97f7480 x1873176872104832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400791 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400775.926591:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872104832:0@lo:13: 00100000:10000000:3.0:1786400775.928329:0:7483:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1786400775.928381:0:7483:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1786400775.928440:0:7483:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1786400775.928467:0:7483:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1786400775.928791:0:7483:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1786400775.928803:0:7483:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1786400775.928821:0:7483:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5ccaaf4f3cb1d77a 00000020:01000004:3.0:1786400775.928830:0:7483:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1786400775.928852:0:7483:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.108@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1786400775.928856:0:7483:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.108@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1786400775.928862:0:7483:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1786400775.928885:0:7483:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1786400775.928890:0:7483:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.108@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1786400775.972028:0:7483:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.108@tcp ctxt 0 is initialized 00000020:01000004:3.0:1786400775.973258:0:7483:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.108@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1786400775.973265:0:7483:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1786400775.973266:0:7483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1786400775.973268:0:7483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786400775.973269:0:7483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786400775.973270:0:7483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786400775.973272:0:7483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786400775.973273:0:7483:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1786400775.973275:0:7483:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1786400775.973276:0:7483:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1786400775.973277:0:7483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786400775.973279:0:7483:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1786400775.973284:0:7483:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1786400775.973286:0:7483:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1786400775.973288:0:7483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1786400775.973289:0:7483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786400775.973290:0:7483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786400775.973291:0:7483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786400775.973292:0:7483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786400775.973293:0:7483:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1786400775.973295:0:7483:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1786400775.973296:0:7483:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1786400775.973297:0:7483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786400775.973298:0:7483:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1786400775.973331:0:7483:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1786400775.973365:0:7483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:7483:1873176872104960:0@lo:253: 00000100:00100000:3.0:1786400775.973457:0:7483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400775.973558:0:7483:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffccb79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400775.973612:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872104960 00000100:00100000:0.0:1786400775.973620:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872104960 00000100:00100000:0.0:1786400775.973702:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1786400775.973712:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+16:7483:x1873176872104960:12345-0@lo:253: 20000000:01000000:0.0:1786400775.973743:0:5783:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1786400775.973747:0:5783:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1786400775.973751:0:5783:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1786400775.973754:0:5783:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1786400775.976970:0:5783:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1786400775.977551:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1786400775.977571:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1786400775.977611:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1786400775.977619:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1786400775.977647:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1786400775.977694:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1786400775.979839:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1786400775.979874:0:5783:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.108@tcp 20000000:01000000:2.0:1786400775.979877:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.108@tcp (null) (null) (null) 00000040:00080000:2.0:1786400775.980188:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1786400775.980198:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1786400775.980254:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1786400775.980263:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.108@tcp (null) (null) 00000040:00080000:2.0:1786400775.980304:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1786400775.980315:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1786400775.980362:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1786400775.980414:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1786400775.982941:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1786400775.982977:0:5783:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.108@tcp 20000000:01000000:2.0:1786400775.982980:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.108@tcp (null) (null) (null) 00000040:00080000:2.0:1786400775.983014:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1786400775.983023:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1786400775.983054:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1786400775.985596:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.108@tcp (null) (null) 00000040:00080000:2.0:1786400775.985708:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1786400775.985719:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1786400775.985824:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1786400775.985867:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1786400775.985893:0:5783:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1786400775.985896:0:5783:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1786400775.985903:0:5783:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1786400775.985905:0:5783:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1786400775.985907:0:5783:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1786400775.985922:0:5783:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1786400775.985924:0:5783:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1786400775.985974:0:5783:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1786400775.985977:0:5783:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1786400775.986743:0:7486:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1786400775.986804:0:7486:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1786400775.986857:0:7486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1786400775.987547:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1786400775.987593:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1786400775.987657:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1786400775.987670:0:5783:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1786400775.987673:0:5783:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1786400775.989440:0:7487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1786400775.989823:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1786400775.989870:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1786400775.989968:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1786400775.989982:0:5783:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1786400775.989984:0:5783:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1786400775.992319:0:7488:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1786400775.992428:0:7488:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1786400775.992485:0:7488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1786400775.993476:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1786400775.993525:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1786400775.993559:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1786400775.993571:0:5783:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1786400775.993573:0:5783:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1786400775.995698:0:7489:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1786400775.995823:0:7489:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1786400775.995861:0:7489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1786400775.996672:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1786400775.996720:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1786400775.996782:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:2.0:1786400775.996800:0:5783:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1786400775.996825:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d6fca091200/0x5ccaaf4f3cb1d781 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400775.996845:0:5783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fc0031a00/0x5ccaaf4f3cb1d6d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d6cb expref: 16 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400775.996852:0:5783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fe7d39000/0x5ccaaf4f3cb1d6fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d6f5 expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400775.996860:0:5783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fe7d38600/0x5ccaaf4f3cb1d726 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d71f expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400775.996867:0:5783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fc0030800/0x5ccaaf4f3cb1d742 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d73b expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400775.996874:0:5783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1d76c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d765 expref: 16 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400775.996881:0:5783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d6fca091200/0x5ccaaf4f3cb1d781 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400776.000924:0:5783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1d76c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d765 expref: 16 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400776.000947:0:5783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1d76c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d765 expref: 16 pid: 5781 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400776.000965:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5783:1873176872105088:0@lo:104: 00000100:00100000:2.0:1786400776.001250:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786400776.001366:0:5783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fc0030800/0x5ccaaf4f3cb1d742 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d73b expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400776.001395:0:5783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fc0030800/0x5ccaaf4f3cb1d742 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d73b expref: 16 pid: 5783 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400776.001404:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5783:1873176872105216:0@lo:104: 00010000:00010000:2.0:1786400776.001433:0:5783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fe7d38600/0x5ccaaf4f3cb1d726 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d71f expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400776.001441:0:5783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fe7d38600/0x5ccaaf4f3cb1d726 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d71f expref: 16 pid: 5783 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400776.001450:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5783:1873176872105344:0@lo:104: 00010000:00010000:2.0:1786400776.001471:0:5783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fe7d39000/0x5ccaaf4f3cb1d6fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d6f5 expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400776.001479:0:5783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fe7d39000/0x5ccaaf4f3cb1d6fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d6f5 expref: 16 pid: 5783 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400776.001486:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5783:1873176872105472:0@lo:104: 00010000:00010000:2.0:1786400776.001508:0:5783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fc0031a00/0x5ccaaf4f3cb1d6d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d6cb expref: 16 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400776.001514:0:5783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fc0031a00/0x5ccaaf4f3cb1d6d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d6cb expref: 16 pid: 5780 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400776.001522:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5783:1873176872105600:0@lo:104: 00000100:00100000:2.0:1786400776.001537:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc3509780 going to sleep for 11 seconds 00000100:00100000:3.0:1786400776.001592:0:5771:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1786400776.001616:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400776.001686:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400776.001748:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400776.001769:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872105088 00000100:00100000:0.0:1786400776.001777:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872105088 00000100:00100000:0.0:1786400776.001816:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872105216 00000100:00100000:0.0:1786400776.001819:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872105216 00000100:00100000:0.0:1786400776.001830:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872105344 00000100:00100000:0.0:1786400776.001832:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872105344 00000100:00100000:0.0:1786400776.001865:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1786400776.001873:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc8481450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:97b0324f-e214-4822-8711-e150ddac2a7e+5:5783:x1873176872105088:12345-0@lo:104: 00010000:00010000:0.0:1786400776.001885:0:5772:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031000/0x5ccaaf4f3cb1d765 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d76c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400776.002703:0:5772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786400776.002713:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc8481450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:97b0324f-e214-4822-8711-e150ddac2a7e+5:5783:x1873176872105088:12345-0@lo:104: Request processed in 840us (1652us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400776.002722:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1786400776.002780:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1786400776.002788:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:97b0324f-e214-4822-8711-e150ddac2a7e+4:5783:x1873176872105216:12345-0@lo:104: 00010000:00010000:0.0:1786400776.002798:0:5772:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f000/0x5ccaaf4f3cb1d73b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d742 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400776.002835:0:5772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1786400776.002839:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:97b0324f-e214-4822-8711-e150ddac2a7e+4:5783:x1873176872105216:12345-0@lo:104: Request processed in 54us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400776.002843:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1786400776.002855:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1786400776.002861:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:97b0324f-e214-4822-8711-e150ddac2a7e+3:5783:x1873176872105344:12345-0@lo:104: 00010000:00010000:0.0:1786400776.002868:0:5772:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.108@tcp lock: ffff9d6fca091400/0x5ccaaf4f3cb1d71f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d726 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400776.002890:0:5772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1786400776.002894:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:97b0324f-e214-4822-8711-e150ddac2a7e+3:5783:x1873176872105344:12345-0@lo:104: Request processed in 34us (1208us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400776.002900:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1786400776.002981:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1786400776.002989:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031000/0x5ccaaf4f3cb1d765 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d76c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.002996:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc0031000 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:1.0:1786400776.003001:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031000/0x5ccaaf4f3cb1d765 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5ccaaf4f3cb1d76c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.003009:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031000/0x5ccaaf4f3cb1d765 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5ccaaf4f3cb1d76c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786400776.003025:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031000/0x5ccaaf4f3cb1d765 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5ccaaf4f3cb1d76c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400776.003030:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786400776.003069:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031000/0x5ccaaf4f3cb1d765 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d76c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.003075:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786400776.003112:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031000/0x5ccaaf4f3cb1d765 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d76c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.003120:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031000/0x5ccaaf4f3cb1d765 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d76c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.003133:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786400776.003136:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f000/0x5ccaaf4f3cb1d73b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d742 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.003141:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138f000 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:1.0:1786400776.003144:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f000/0x5ccaaf4f3cb1d73b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5ccaaf4f3cb1d742 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.003149:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f000/0x5ccaaf4f3cb1d73b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5ccaaf4f3cb1d742 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786400776.003154:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f000/0x5ccaaf4f3cb1d73b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5ccaaf4f3cb1d742 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400776.003158:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786400776.003181:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f000/0x5ccaaf4f3cb1d73b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d742 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.003187:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786400776.003202:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f000/0x5ccaaf4f3cb1d73b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d742 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.003207:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f000/0x5ccaaf4f3cb1d73b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d742 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.003218:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786400776.003220:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fca091400/0x5ccaaf4f3cb1d71f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d726 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.003226:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca091400 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:1.0:1786400776.003229:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fca091400/0x5ccaaf4f3cb1d71f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5ccaaf4f3cb1d726 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.003235:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fca091400/0x5ccaaf4f3cb1d71f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5ccaaf4f3cb1d726 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786400776.003240:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fca091400/0x5ccaaf4f3cb1d71f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5ccaaf4f3cb1d726 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400776.003245:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786400776.003256:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6fca091400/0x5ccaaf4f3cb1d71f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d726 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.003261:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786400776.003266:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fca091400/0x5ccaaf4f3cb1d71f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d726 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.003283:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fca091400/0x5ccaaf4f3cb1d71f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d726 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.003292:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400776.003294:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400776.003296:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400776.003302:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400776.003315:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:97b0324f-e214-4822-8711-e150ddac2a7e:3309:1873176872105728:0@lo:103: 00000100:00100000:1.0:1786400776.003367:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400776.003410:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:97b0324f-e214-4822-8711-e150ddac2a7e:3306:1873176872105856:0@lo:103: 00000100:00100000:1.0:1786400776.003433:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400776.003451:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786400776.003457:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:97b0324f-e214-4822-8711-e150ddac2a7e:3306:1873176872105984:0@lo:103: 00000100:00100000:1.0:1786400776.003474:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400776.003501:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872105728 00000100:00100000:1.0:1786400776.003508:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872105728 00010000:00010000:1.0:1786400776.003528:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1d76c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d765 expref: 17 pid: 5781 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400776.003544:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872105856 00000100:00100000:1.0:1786400776.003547:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872105856 00010000:00010000:1.0:1786400776.003570:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fc0030800/0x5ccaaf4f3cb1d742 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d73b expref: 18 pid: 5783 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400776.003581:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872105984 00000100:00100000:1.0:1786400776.003584:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872105984 00010000:00010000:1.0:1786400776.003593:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fe7d38600/0x5ccaaf4f3cb1d726 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d71f expref: 19 pid: 5783 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400776.003615:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1786400776.003622:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:97b0324f-e214-4822-8711-e150ddac2a7e+19:3309:x1873176872105728:12345-0@lo:103: 00010000:00010000:1.0:1786400776.003632:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400776.003637:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1d76c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d765 expref: 19 pid: 5781 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.003645:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1d76c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d765 expref: 19 pid: 5781 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.003661:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400776.003689:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:97b0324f-e214-4822-8711-e150ddac2a7e+19:3309:x1873176872105728:12345-0@lo:103: Request processed in 69us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400776.003694:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1786400776.003707:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1786400776.003713:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:97b0324f-e214-4822-8711-e150ddac2a7e+18:3306:x1873176872105856:12345-0@lo:103: 00010000:00010000:1.0:1786400776.003720:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400776.003724:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fc0030800/0x5ccaaf4f3cb1d742 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d73b expref: 18 pid: 5783 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.003732:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fc0030800/0x5ccaaf4f3cb1d742 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d73b expref: 18 pid: 5783 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.003741:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400776.003765:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:97b0324f-e214-4822-8711-e150ddac2a7e+18:3306:x1873176872105856:12345-0@lo:103: Request processed in 52us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400776.003770:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1786400776.003781:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1786400776.003792:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:97b0324f-e214-4822-8711-e150ddac2a7e+17:3306:x1873176872105984:12345-0@lo:103: 00010000:00010000:1.0:1786400776.003799:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400776.003803:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fe7d38600/0x5ccaaf4f3cb1d726 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d71f expref: 17 pid: 5783 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.003811:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fe7d38600/0x5ccaaf4f3cb1d726 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d71f expref: 17 pid: 5783 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.003820:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400776.003840:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:97b0324f-e214-4822-8711-e150ddac2a7e+17:3306:x1873176872105984:12345-0@lo:103: Request processed in 48us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400776.003845:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1786400776.003881:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:97b0324f-e214-4822-8711-e150ddac2a7e:3306:1873176872105984:0@lo:103: 00000100:00100000:1.0:1786400776.003891:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:97b0324f-e214-4822-8711-e150ddac2a7e:3306:1873176872105856:0@lo:103: 00000100:00100000:1.0:1786400776.003915:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:97b0324f-e214-4822-8711-e150ddac2a7e:3309:1873176872105728:0@lo:103: 00000100:00100000:3.0:1786400776.006021:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400776.006039:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872105472 00000100:00100000:3.0:1786400776.006046:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872105472 00000100:00100000:3.0:1786400776.006101:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872105600 00000100:00100000:3.0:1786400776.006105:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872105600 00000100:00100000:3.0:1786400776.006121:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1786400776.006128:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:97b0324f-e214-4822-8711-e150ddac2a7e+4:5783:x1873176872105472:12345-0@lo:104: 00010000:00010000:3.0:1786400776.006142:0:5771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.108@tcp lock: ffff9d6fca090e00/0x5ccaaf4f3cb1d6f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d6fc expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400776.006198:0:5771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786400776.006203:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:97b0324f-e214-4822-8711-e150ddac2a7e+4:5783:x1873176872105472:12345-0@lo:104: Request processed in 76us (4455us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400776.006209:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1786400776.006223:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1786400776.006228:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:97b0324f-e214-4822-8711-e150ddac2a7e+3:5783:x1873176872105600:12345-0@lo:104: 00010000:00010000:3.0:1786400776.006235:0:5771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d6cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d6d2 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400776.006259:0:5771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1786400776.006263:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:97b0324f-e214-4822-8711-e150ddac2a7e+3:5783:x1873176872105600:12345-0@lo:104: Request processed in 35us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400776.006268:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1786400776.006594:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786400776.006602:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fca090e00/0x5ccaaf4f3cb1d6f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d6fc expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.006609:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca090e00 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:1.0:1786400776.006613:0:5776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fca090e00/0x5ccaaf4f3cb1d6f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5ccaaf4f3cb1d6fc expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.006622:0:5776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fca090e00/0x5ccaaf4f3cb1d6f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5ccaaf4f3cb1d6fc expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786400776.006629:0:5776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fca090e00/0x5ccaaf4f3cb1d6f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5ccaaf4f3cb1d6fc expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400776.006652:0:5776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786400776.006687:0:5776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6fca090e00/0x5ccaaf4f3cb1d6f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d6fc expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.006693:0:5776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786400776.006726:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fca090e00/0x5ccaaf4f3cb1d6f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d6fc expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.006733:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fca090e00/0x5ccaaf4f3cb1d6f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d6fc expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.006746:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786400776.006748:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d6cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d6d2 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.006753:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138f600 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:1.0:1786400776.006756:0:5776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d6cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5ccaaf4f3cb1d6d2 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.006762:0:5776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d6cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5ccaaf4f3cb1d6d2 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786400776.006768:0:5776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d6cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5ccaaf4f3cb1d6d2 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400776.006774:0:5776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786400776.006786:0:5776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d6cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d6d2 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.006792:0:5776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786400776.006803:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d6cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d6d2 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.006809:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d6cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d6d2 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.006823:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400776.006825:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400776.006827:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400776.006842:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:97b0324f-e214-4822-8711-e150ddac2a7e:3309:1873176872106240:0@lo:103: 00000100:00100000:1.0:1786400776.006882:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400776.006918:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786400776.006924:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:97b0324f-e214-4822-8711-e150ddac2a7e:3309:1873176872106112:0@lo:103: 00000100:00100000:1.0:1786400776.006945:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400776.006970:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872106240 00000100:00100000:1.0:1786400776.006974:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872106240 00010000:00010000:1.0:1786400776.006993:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fc0031a00/0x5ccaaf4f3cb1d6d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d6cb expref: 17 pid: 5780 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400776.007012:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872106112 00000100:00100000:1.0:1786400776.007015:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872106112 00010000:00010000:1.0:1786400776.007027:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fe7d39000/0x5ccaaf4f3cb1d6fc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d6f5 expref: 18 pid: 5783 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400776.007039:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1786400776.007046:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:97b0324f-e214-4822-8711-e150ddac2a7e+18:3309:x1873176872106240:12345-0@lo:103: 00010000:00010000:1.0:1786400776.007056:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400776.007839:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fc0031a00/0x5ccaaf4f3cb1d6d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d6cb expref: 18 pid: 5780 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.007869:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fc0031a00/0x5ccaaf4f3cb1d6d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d6cb expref: 18 pid: 5780 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.007888:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400776.007928:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:97b0324f-e214-4822-8711-e150ddac2a7e+18:3309:x1873176872106240:12345-0@lo:103: Request processed in 882us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400776.007935:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1786400776.007954:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1786400776.007961:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:97b0324f-e214-4822-8711-e150ddac2a7e+17:3309:x1873176872106112:12345-0@lo:103: 00010000:00010000:1.0:1786400776.007969:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400776.007974:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fe7d39000/0x5ccaaf4f3cb1d6fc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d6f5 expref: 17 pid: 5783 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.007982:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fe7d39000/0x5ccaaf4f3cb1d6fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d6f5 expref: 17 pid: 5783 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.007993:0:5773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d6fca091200/0x5ccaaf4f3cb1d781 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.008001:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fca091200/0x5ccaaf4f3cb1d781 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.008015:0:5773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fca091200/0x5ccaaf4f3cb1d781 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.008022:0:5773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fca091200/0x5ccaaf4f3cb1d781 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.008028:0:5773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d6fca091200/0x5ccaaf4f3cb1d781 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.008041:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d6fca091200/0x5ccaaf4f3cb1d781 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.008047:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca091200 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:1.0:1786400776.008052:0:5773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d6fca091200/0x5ccaaf4f3cb1d781 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.009416:0:5773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d6fca091200/0x5ccaaf4f3cb1d781 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.009432:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d6fca091200/0x5ccaaf4f3cb1d781 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.009447:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400776.009502:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:97b0324f-e214-4822-8711-e150ddac2a7e+17:3309:x1873176872106112:12345-0@lo:103: Request processed in 1539us (2553us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400776.009511:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1786400776.009577:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:97b0324f-e214-4822-8711-e150ddac2a7e:3309:1873176872106112:0@lo:103: 00000100:00100000:1.0:1786400776.009588:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:97b0324f-e214-4822-8711-e150ddac2a7e:3309:1873176872106240:0@lo:103: 00010000:00010000:1.0:1786400776.009612:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400776.009705:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1d76c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d765 expref: 16 pid: 5781 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400776.009732:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5783:1873176872105088:0@lo:104: 00010000:00010000:2.0:1786400776.009746:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc0030800/0x5ccaaf4f3cb1d742 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d73b expref: 15 pid: 5783 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400776.009756:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5783:1873176872105216:0@lo:104: 00010000:00010000:2.0:1786400776.009764:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe7d38600/0x5ccaaf4f3cb1d726 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d71f expref: 14 pid: 5783 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400776.009771:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5783:1873176872105344:0@lo:104: 00010000:00010000:2.0:1786400776.009779:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe7d39000/0x5ccaaf4f3cb1d6fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d6f5 expref: 13 pid: 5783 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400776.009787:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5783:1873176872105472:0@lo:104: 00010000:00010000:2.0:1786400776.009795:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc0031a00/0x5ccaaf4f3cb1d6d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d6cb expref: 12 pid: 5780 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400776.009806:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5783:1873176872105600:0@lo:104: 00010000:00010000:2.0:1786400776.009824:0:5783:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d6fca091200/0x5ccaaf4f3cb1d781 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400776.009831:0:5783:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d6fca091200/0x5ccaaf4f3cb1d781 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400776.009837:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d6fca091200/0x5ccaaf4f3cb1d781 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400776.009843:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fca091200/0x5ccaaf4f3cb1d781 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1786400776.009863:0:5783:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:1.0:1786400776.114362:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400776.145601:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+11:7483:x1873176872104960:12345-0@lo:253: Request processed in 171874us (172127us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400776.145617:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1786400776.145904:0:7483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:7483:1873176872104960:0@lo:253: 10000000:01000000:3.0:1786400776.145920:0:7483:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1786400776.145924:0:7483:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1786400776.145942:0:7483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1786400776.145944:0:7483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786400776.145945:0:7483:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1786400776.145946:0:7483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786400776.145948:0:7483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786400776.145950:0:7483:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1786400776.145951:0:7483:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1786400776.145953:0:7483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786400776.145954:0:7483:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1786400776.145975:0:7483:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d6ec470a000 from lustre-OST0001 10000000:01000000:3.0:1786400776.146003:0:7483:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1786400776.146006:0:7483:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1786400776.146014:0:7483:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d6fc523cd40 local copy 10000000:01000000:3.0:1786400776.146018:0:7483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1786400776.147179:0:7483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38200/0x5ccaaf4f3cb1d788 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400776.147195:0:7483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38200/0x5ccaaf4f3cb1d788 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400776.147206:0:7483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38200/0x5ccaaf4f3cb1d788 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400776.147231:0:7483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:7483:1873176872106368:0@lo:101: 00000100:00100000:3.0:1786400776.147286:0:7483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400776.147407:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872106368 00000100:00100000:2.0:1786400776.147415:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872106368 00000100:00100000:2.0:1786400776.147463:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1786400776.147476:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+11:7483:x1873176872106368:12345-0@lo:101: 00000100:00100000:3.0:1786400776.147481:0:7483:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffccb7c00 going to sleep for 11 seconds 00010000:00010000:2.0:1786400776.147490:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400776.147507:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fca091200/0x5ccaaf4f3cb1d78f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d788 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400776.147533:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fca091200/0x5ccaaf4f3cb1d78f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d788 expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400776.147545:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fca091200/0x5ccaaf4f3cb1d78f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d788 expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400776.147553:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca091200, rc 0) 00000100:00100000:2.0:1786400776.147733:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+12:7483:x1873176872106368:12345-0@lo:101: Request processed in 261us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400776.147740:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1786400776.148172:0:7483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:7483:1873176872106368:0@lo:101: 00010000:00010000:3.0:1786400776.148187:0:7483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38200/0x5ccaaf4f3cb1d788 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5ccaaf4f3cb1d78f expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400776.148196:0:7483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38200/0x5ccaaf4f3cb1d788 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5ccaaf4f3cb1d78f expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400776.148320:0:7483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:7483:1873176872106496:0@lo:501: 00000100:00100000:3.0:1786400776.148365:0:7483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400776.148398:0:7483:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffccb7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1786400776.150685:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872106496 00000100:00100000:1.0:1786400776.150701:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872106496 00000100:00100000:1.0:1786400776.150778:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1786400776.150789:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+12:7483:x1873176872106496:12345-0@lo:501: 00000100:00100000:1.0:1786400776.151534:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+12:7483:x1873176872106496:12345-0@lo:501: Request processed in 743us (3165us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786400776.151543:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1786400776.152238:0:7483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:7483:1873176872106496:0@lo:501: 10000000:01000000:3.0:1786400776.152267:0:7483:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.108@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1786400776.152314:0:7483:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.108@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1786400776.152323:0:7483:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38200/0x5ccaaf4f3cb1d788 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5ccaaf4f3cb1d78f expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400776.152336:0:7483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38200/0x5ccaaf4f3cb1d788 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5ccaaf4f3cb1d78f expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400776.152361:0:7483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38200/0x5ccaaf4f3cb1d788 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5ccaaf4f3cb1d78f expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400776.152392:0:7483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1786400776.152423:0:7483:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d6ec470a000 00010000:00010000:1.0:1786400776.152426:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:3.0:1786400776.152429:0:7483:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1786400776.152434:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38200/0x5ccaaf4f3cb1d788 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5ccaaf4f3cb1d78f expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400776.152437:0:7483:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1786400776.152443:0:7483:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1786400776.152447:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7d38200 already unused, calling callback (ffffffffc1d6dc20) 10000000:01000000:3.0:1786400776.152449:0:7483:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:00010000:1.0:1786400776.152453:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38200/0x5ccaaf4f3cb1d788 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5ccaaf4f3cb1d78f expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400776.152454:0:7483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1786400776.152466:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38200/0x5ccaaf4f3cb1d788 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x5ccaaf4f3cb1d78f expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786400776.152475:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38200/0x5ccaaf4f3cb1d788 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x5ccaaf4f3cb1d78f expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400776.152481:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1786400776.152493:0:7483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39200/0x5ccaaf4f3cb1d796 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400776.152504:0:7483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39200/0x5ccaaf4f3cb1d796 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.152506:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38200/0x5ccaaf4f3cb1d788 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x5ccaaf4f3cb1d78f expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.152519:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786400776.152537:0:7483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39200/0x5ccaaf4f3cb1d796 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400776.152555:0:7483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:7483:1873176872106624:0@lo:101: 00010000:00010000:1.0:1786400776.152559:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38200/0x5ccaaf4f3cb1d788 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5ccaaf4f3cb1d78f expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.152568:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38200/0x5ccaaf4f3cb1d788 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5ccaaf4f3cb1d78f expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.152591:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400776.152593:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400776.152603:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400776.152605:0:7483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400776.152628:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872106624 00000100:00100000:1.0:1786400776.152635:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872106624 00000100:00100000:3.0:1786400776.152639:0:7483:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffccb73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786400776.152671:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1786400776.152680:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+12:7483:x1873176872106624:12345-0@lo:101: 00010000:00010000:1.0:1786400776.152692:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1786400776.152705:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1786400776.152708:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d79d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d796 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400776.152719:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:97b0324f-e214-4822-8711-e150ddac2a7e:3307:1873176872106752:0@lo:103: 00010000:00010000:1.0:1786400776.152735:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d79d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d796 expref: 13 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.152747:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d79d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d796 expref: 13 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.152757:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138f600, rc 0) 00000100:00100000:0.0:1786400776.152758:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400776.152801:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+13:7483:x1873176872106624:12345-0@lo:101: Request processed in 120us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400776.152810:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1786400776.152811:0:7483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:7483:1873176872106624:0@lo:101: 00010000:00010000:0.0:1786400776.152831:0:7483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39200/0x5ccaaf4f3cb1d796 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d79d expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400776.152841:0:7483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39200/0x5ccaaf4f3cb1d796 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d79d expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400776.152848:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872106752 00000100:00100000:1.0:1786400776.152853:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872106752 00000100:00100000:1.0:1786400776.152886:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786400776.152894:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d7000dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:97b0324f-e214-4822-8711-e150ddac2a7e+13:3307:x1873176872106752:12345-0@lo:103: 00010000:00010000:1.0:1786400776.152903:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400776.152916:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fca091200/0x5ccaaf4f3cb1d78f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d788 expref: 13 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400776.152918:0:7483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:7483:1873176872106880:0@lo:501: 00010000:00010000:1.0:1786400776.152932:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400776.154002:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d7000dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:97b0324f-e214-4822-8711-e150ddac2a7e+12:3307:x1873176872106752:12345-0@lo:103: Request processed in 1101us (1236us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400776.154025:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1786400776.154043:0:7483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400776.154108:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:97b0324f-e214-4822-8711-e150ddac2a7e:3307:1873176872106752:0@lo:103: 00000100:00100000:0.0:1786400776.154136:0:7483:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd0bebb40 going to sleep for 11 seconds 00000100:00100000:3.0:1786400776.154200:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872106880 00000100:00100000:3.0:1786400776.154206:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872106880 00000100:00100000:3.0:1786400776.154286:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1786400776.154295:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+12:7483:x1873176872106880:12345-0@lo:501: 00000100:00100000:3.0:1786400776.155188:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+12:7483:x1873176872106880:12345-0@lo:501: Request processed in 891us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400776.155197:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1786400776.155448:0:7483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:7483:1873176872106880:0@lo:501: 00000100:00100000:0.0:1786400776.155492:0:7483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:7483:1873176872107008:0@lo:503: 00000100:00100000:0.0:1786400776.155538:0:7483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400776.156248:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872107008 00000100:00100000:1.0:1786400776.156255:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872107008 00000100:00100000:1.0:1786400776.156291:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1786400776.156298:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+12:7483:x1873176872107008:12345-0@lo:503: 00000100:00100000:2.0:1786400776.156461:0:7483:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd0bebb40 going to sleep for 11 seconds 00000100:00100000:1.0:1786400776.156513:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+12:7483:x1873176872107008:12345-0@lo:503: Request processed in 214us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400776.156520:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1786400776.156645:0:7483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:7483:1873176872107008:0@lo:503: 00000040:00080000:2.0:1786400776.156954:0:7483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1786400776.157014:0:7483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:7483:1873176872107136:0@lo:502: 00000100:00100000:2.0:1786400776.157068:0:7483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400776.157111:0:7483:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc35093c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400776.157141:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872107136 00000100:00100000:0.0:1786400776.157147:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872107136 00000100:00100000:0.0:1786400776.157175:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1786400776.157182:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+12:7483:x1873176872107136:12345-0@lo:502: 00000100:00100000:0.0:1786400776.157325:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+12:7483:x1873176872107136:12345-0@lo:502: Request processed in 142us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400776.157332:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1786400776.158767:0:7483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:7483:1873176872107136:0@lo:502: 00000040:00080000:2.0:1786400776.159761:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1786400776.159855:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1786400776.159892:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1786400776.159941:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1786400776.159980:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1786400776.160014:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1786400776.160854:0:7483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:7483:1873176872107264:0@lo:502: 00000100:00100000:2.0:1786400776.160954:0:7483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400776.161726:0:7483:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc35093c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400776.161840:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872107264 00000100:00100000:0.0:1786400776.161849:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872107264 00000100:00100000:0.0:1786400776.161911:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1786400776.161921:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+12:7483:x1873176872107264:12345-0@lo:502: 00000100:00100000:2.0:1786400776.163922:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+12:7483:x1873176872107264:12345-0@lo:502: Request processed in 1994us (2961us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400776.163936:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1786400776.164797:0:7483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:7483:1873176872107264:0@lo:502: 00000040:00080000:3.0:1786400776.164981:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1786400776.164997:0:7483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1786400776.166827:0:7492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1786400776.166837:0:7492:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1786400776.166844:0:7492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400776.166846:0:7492:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1786400776.166852:0:7492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1786400776.166868:0:7492:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9d6fc6554d40) 00000020:00000080:1.0:1786400776.166893:0:7492:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1786400776.166899:0:7492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1786400776.166961:0:7492:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d6ec470a000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1786400776.166968:0:7492:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1786400776.166975:0:7492:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5ccaaf4f3cb1d7ab 00010000:00010000:1.0:1786400776.177276:0:7492:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1786400776.178368:0:7492:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1786400776.186467:0:7492:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1786400776.186988:0:7492:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1786400776.203334:0:7492:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1786400776.206653:0:7492:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1786400776.210234:0:7492:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1786400776.210249:0:7492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786400776.210257:0:7492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786400776.210259:0:7492:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1786400776.210262:0:7492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786400776.210266:0:7492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786400776.210267:0:7492:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1786400776.210281:0:7492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1786400776.210282:0:7492:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1786400776.210356:0:7492:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786400776.210360:0:7492:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786400776.210361:0:7492:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1786400776.210364:0:7492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1786400776.210529:0:7483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1786400776.210556:0:7483:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1786400776.210579:0:7483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39200/0x5ccaaf4f3cb1d796 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d79d expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400776.210605:0:7483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39200/0x5ccaaf4f3cb1d796 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d79d expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786400776.210614:0:7483:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6ec470a000 from 1 10000000:01000000:0.0:1786400776.210617:0:7483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1786400776.210654:0:7483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc0030a00/0x5ccaaf4f3cb1d7b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400776.210662:0:7483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fc0030a00/0x5ccaaf4f3cb1d7b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400776.210672:0:7483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fc0030a00/0x5ccaaf4f3cb1d7b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400776.210697:0:7483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:7483:1873176872107392:0@lo:101: 00000100:00100000:0.0:1786400776.210767:0:7483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400776.210803:0:7483:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd0beb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786400776.210963:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872107392 00000100:00100000:3.0:1786400776.210971:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872107392 00000100:00100000:3.0:1786400776.212139:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1786400776.212156:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+12:7483:x1873176872107392:12345-0@lo:101: 00010000:00010000:3.0:1786400776.212173:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400776.212189:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1d7b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d7b2 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400776.212219:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1d7b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d7b2 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400776.212230:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1d7b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d7b2 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400776.212240:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7d38000, rc 0) 00000100:00100000:3.0:1786400776.212310:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+13:7483:x1873176872107392:12345-0@lo:101: Request processed in 160us (1543us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400776.212317:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1786400776.216997:0:7483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:7483:1873176872107392:0@lo:101: 00010000:00010000:2.0:1786400776.217027:0:7483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fc0030a00/0x5ccaaf4f3cb1d7b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d7b9 expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400776.217041:0:7483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fc0030a00/0x5ccaaf4f3cb1d7b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d7b9 expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400776.217204:0:7483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:7483:1873176872107520:0@lo:501: 00000100:00100000:2.0:1786400776.217262:0:7483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400776.218839:0:7483:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc35090c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400776.218881:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872107520 00000100:00100000:0.0:1786400776.218890:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872107520 00000100:00100000:0.0:1786400776.218939:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1786400776.218949:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+13:7483:x1873176872107520:12345-0@lo:501: 00000100:00100000:0.0:1786400776.220000:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+13:7483:x1873176872107520:12345-0@lo:501: Request processed in 1047us (2732us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400776.220017:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1786400776.220487:0:7483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:7483:1873176872107520:0@lo:501: 00000100:00100000:0.0:1786400776.220540:0:7483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:7483:1873176872107648:0@lo:503: 00000100:00100000:0.0:1786400776.220602:0:7483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400776.220728:0:7483:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd0beb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786400776.220824:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872107648 00000100:00100000:3.0:1786400776.220830:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872107648 00000100:00100000:1.0:1786400776.220898:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1786400776.220909:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+13:7483:x1873176872107648:12345-0@lo:503: 00000100:00100000:1.0:1786400776.221796:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+13:7483:x1873176872107648:12345-0@lo:503: Request processed in 887us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400776.221806:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1786400776.222349:0:7483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:7483:1873176872107648:0@lo:503: 00000040:00080000:0.0:1786400776.223513:0:7483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1786400776.223763:0:7483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:7483:1873176872107776:0@lo:502: 00000100:00100000:0.0:1786400776.223888:0:7483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400776.224505:0:7483:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd0beb3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400776.224602:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872107776 00000100:00100000:2.0:1786400776.224610:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872107776 00000100:00100000:1.0:1786400776.224674:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1786400776.224686:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+13:7483:x1873176872107776:12345-0@lo:502: 00000100:00100000:1.0:1786400776.224937:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+13:7483:x1873176872107776:12345-0@lo:502: Request processed in 252us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400776.224945:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1786400776.225820:0:7483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:7483:1873176872107776:0@lo:502: 00000040:00080000:0.0:1786400776.227419:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1786400776.227505:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1786400776.227550:0:7483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:7483:1873176872107904:0@lo:502: 00000100:00100000:0.0:1786400776.227630:0:7483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400776.227750:0:7483:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd0beb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786400776.227959:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872107904 00000100:00100000:1.0:1786400776.227969:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872107904 00000100:00100000:1.0:1786400776.228023:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1786400776.228034:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+13:7483:x1873176872107904:12345-0@lo:502: 00000100:00100000:1.0:1786400776.228353:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+13:7483:x1873176872107904:12345-0@lo:502: Request processed in 320us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400776.228361:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1786400776.228523:0:7483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:7483:1873176872107904:0@lo:502: 00000040:00080000:0.0:1786400776.228703:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1786400776.228714:0:7483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1786400776.231964:0:7496:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786400776.232206:0:7496:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786400776.232208:0:7496:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1786400776.232217:0:7496:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d6ec470a000 00000020:00000080:0.0:1786400776.232219:0:7496:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1786400776.232485:0:7496:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786400776.232490:0:7496:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786400776.232492:0:7496:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1786400776.232495:0:7496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1786400776.232678:0:7483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1786400776.232711:0:7483:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1786400776.232779:0:7483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc0030a00/0x5ccaaf4f3cb1d7b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d7b9 expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400776.232791:0:7483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fc0030a00/0x5ccaaf4f3cb1d7b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d7b9 expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786400776.232848:0:7483:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1786400776.232851:0:7483:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d6ec470a000 10000000:01000000:2.0:1786400776.232854:0:7483:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d6ec470a000 10000000:01000000:2.0:1786400776.232859:0:7483:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1786400776.232863:0:7483:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d6ec470a000 from 1 10000000:01000000:2.0:1786400776.232866:0:7483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1786400776.232904:0:7483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fca090200/0x5ccaaf4f3cb1d7c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400776.232911:0:7483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fca090200/0x5ccaaf4f3cb1d7c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400776.232922:0:7483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fca090200/0x5ccaaf4f3cb1d7c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400776.232946:0:7483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:7483:1873176872108032:0@lo:101: 00000100:00100000:2.0:1786400776.233015:0:7483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400776.233077:0:7483:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc35093c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400776.233277:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872108032 00000100:00100000:0.0:1786400776.233284:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872108032 00000100:00100000:0.0:1786400776.233328:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1786400776.233350:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+13:7483:x1873176872108032:12345-0@lo:101: 00010000:00010000:0.0:1786400776.233373:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400776.233385:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fc0030000/0x5ccaaf4f3cb1d7c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d7c0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400776.233408:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc0030000/0x5ccaaf4f3cb1d7c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d7c0 expref: 14 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400776.233419:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fc0030000/0x5ccaaf4f3cb1d7c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d7c0 expref: 14 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400776.233428:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc0030000, rc 0) 00000100:00100000:0.0:1786400776.233471:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+14:7483:x1873176872108032:12345-0@lo:101: Request processed in 135us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400776.233477:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1786400776.233491:0:7483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:7483:1873176872108032:0@lo:101: 00010000:00010000:1.0:1786400776.233507:0:7483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fca090200/0x5ccaaf4f3cb1d7c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d7c7 expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.233516:0:7483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fca090200/0x5ccaaf4f3cb1d7c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d7c7 expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400776.233628:0:7483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:7483:1873176872108160:0@lo:501: 00000100:00100000:1.0:1786400776.233653:0:7483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400776.233841:0:7483:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc4579f00 going to sleep for 11 seconds 00000100:00100000:0.0:1786400776.234357:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872108160 00000100:00100000:0.0:1786400776.234364:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872108160 00000100:00100000:0.0:1786400776.234433:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1786400776.234441:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+14:7483:x1873176872108160:12345-0@lo:501: 00000100:00100000:0.0:1786400776.234838:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+14:7483:x1873176872108160:12345-0@lo:501: Request processed in 397us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400776.234846:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1786400776.234918:0:7483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:7483:1873176872108160:0@lo:501: 00000100:00100000:2.0:1786400776.234963:0:7483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:7483:1873176872108288:0@lo:503: 00000100:00100000:2.0:1786400776.235005:0:7483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400776.235039:0:7483:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc3509cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400776.235117:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872108288 00000100:00100000:0.0:1786400776.235121:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872108288 00000100:00100000:0.0:1786400776.235147:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1786400776.235154:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+14:7483:x1873176872108288:12345-0@lo:503: 00000100:00100000:0.0:1786400776.235294:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+14:7483:x1873176872108288:12345-0@lo:503: Request processed in 139us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400776.235301:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1786400776.235789:0:7483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:7483:1873176872108288:0@lo:503: 00000040:00080000:2.0:1786400776.236222:0:7483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1786400776.236286:0:7483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:7483:1873176872108416:0@lo:502: 00000100:00100000:2.0:1786400776.236346:0:7483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400776.236421:0:7483:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc3509cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400776.236463:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872108416 00000100:00100000:0.0:1786400776.236468:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872108416 00000100:00100000:0.0:1786400776.236544:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1786400776.236554:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+14:7483:x1873176872108416:12345-0@lo:502: 00000100:00100000:0.0:1786400776.236871:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+14:7483:x1873176872108416:12345-0@lo:502: Request processed in 317us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400776.236878:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1786400776.236955:0:7483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:7483:1873176872108416:0@lo:502: 00000040:00080000:2.0:1786400776.237785:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1786400776.237851:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1786400776.237884:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1786400776.237934:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1786400776.237971:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1786400776.238031:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1786400776.238121:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1786400776.238159:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1786400776.238220:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1786400776.238420:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1786400776.238459:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1786400776.238528:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1786400776.238565:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1786400776.238658:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1786400776.238790:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1786400776.238827:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1786400776.238859:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1786400776.238902:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1786400776.238935:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1786400776.238986:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1786400776.239057:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1786400776.239314:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1786400776.239390:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1786400776.239445:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1786400776.239481:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1786400776.239513:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1786400776.239570:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1786400776.240042:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1786400776.240376:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1786400776.240432:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1786400776.240473:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1786400776.240498:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1786400776.240523:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1786400776.240558:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1786400776.240585:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1786400776.240647:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1786400776.240691:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1786400776.240742:0:7483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:7483:1873176872108544:0@lo:502: 00000100:00100000:2.0:1786400776.240827:0:7483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400776.240912:0:7483:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc3509cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786400776.241071:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872108544 00000100:00100000:1.0:1786400776.241081:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872108544 00000100:00100000:1.0:1786400776.241333:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1786400776.241354:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+14:7483:x1873176872108544:12345-0@lo:502: 00000100:00100000:1.0:1786400776.241821:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+14:7483:x1873176872108544:12345-0@lo:502: Request processed in 466us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400776.241837:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1786400776.242078:0:7483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:7483:1873176872108544:0@lo:502: 00000040:00080000:2.0:1786400776.242206:0:7483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1786400776.242219:0:7483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1786400776.243437:0:7497:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1786400776.243455:0:7497:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9d6fe903b380) 00000020:00000080:2.0:1786400776.243477:0:7497:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1786400776.243764:0:7497:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d6ec470a000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1786400776.243769:0:7497:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d6ec470a000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1786400776.243771:0:7497:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d6ec470a000 3 00010000:00080000:2.0:1786400776.243800:0:7497:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d6ec5079000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.108@tcp at head 00010000:00010000:2.0:1786400776.247380:0:7497:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1786400776.247479:0:7497:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1786400776.247516:0:7497:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1786400776.247528:0:7497:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5ccaaf4f3cb1d7d5 00000100:00080000:2.0:1786400776.247538:0:7497:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1786400776.247543:0:7497:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9d6ec5079000 using connection 192.168.204.108@tcp/0@lo 00000100:00100000:2.0:1786400776.247577:0:7497:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6fee30fb80 x1873176872108672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786400776.248941:0:7497:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1786400776.249171:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1873176872108672:0@lo:38: 00000100:00100000:1.0:1786400776.249245:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400776.251429:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872108672 00000100:00100000:2.0:1786400776.251443:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872108672 00000100:00100000:2.0:1786400776.251498:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1786400776.251508:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1873176872108672:12345-0@lo:38: 00010000:00080000:2.0:1786400776.251537:0:5788:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 228 last 0 00000020:00000080:2.0:1786400776.251576:0:5788:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5ccaaf4f3cb1d7dc 00000004:00100000:2.0:1786400776.251647:0:5788:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1786400776.251684:0:5788:0:(import.c:65:import_set_state_nolock()) ffff9d6ec4d85000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786400776.251762:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1873176872108672:12345-0@lo:38: Request processed in 255us (2517us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400776.251770:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1786400776.251869:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6fee30fb80 x1873176872108672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786400786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400776.251882:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1786400776.251892:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1786400776.251899:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1786400776.251904:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1786400776.251906:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9d6ec5079000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1786400776.251912:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1873176872108672:0@lo:38: 00000040:00080000:1.0:1786400776.252418:0:7497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1786400776.252468:0:7483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1786400776.252499:0:7483:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1786400776.252519:0:7483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fca090200/0x5ccaaf4f3cb1d7c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d7c7 expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.252530:0:7483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fca090200/0x5ccaaf4f3cb1d7c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d7c7 expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1786400776.252575:0:7483:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1786400776.252577:0:7483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1786400776.252578:0:7483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786400776.252579:0:7483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786400776.252581:0:7483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786400776.252582:0:7483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786400776.252583:0:7483:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786400776.252585:0:7483:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1786400776.252586:0:7483:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1786400776.252666:0:7483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786400776.252668:0:7483:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1786400776.252671:0:7483:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1786400776.252673:0:7483:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1786400776.252675:0:7483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1786400776.252675:0:7483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786400776.252676:0:7483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786400776.252677:0:7483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786400776.252678:0:7483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786400776.252679:0:7483:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786400776.252681:0:7483:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1786400776.252681:0:7483:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1786400776.252682:0:7483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786400776.252683:0:7483:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1786400776.252707:0:7483:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1786400776.252723:0:7483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:7483:1873176872108800:0@lo:253: 00000100:00100000:1.0:1786400776.252776:0:7483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400776.252811:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872108800 00000100:00100000:1.0:1786400776.252816:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872108800 00000100:00100000:1.0:1786400776.252854:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1786400776.252863:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+14:7483:x1873176872108800:12345-0@lo:253: 20000000:01000000:1.0:1786400776.252902:0:5781:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1786400776.252915:0:5781:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1786400776.253224:0:7499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30e300 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7499:1873176872108928:0@lo:901: 00000100:00100000:2.0:1786400776.253263:0:7499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400776.253284:0:7499:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc3509780 going to sleep for 11 seconds 00000100:00100000:1.0:1786400776.255364:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872108928 00000100:00100000:1.0:1786400776.255377:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872108928 00000100:00100000:1.0:1786400776.255437:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786400776.255446:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee30ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7499:x1873176872108928:12345-0@lo:901: 00000100:00100000:1.0:1786400776.255811:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee30ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7499:x1873176872108928:12345-0@lo:901: Request processed in 364us (2545us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400776.255818:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786400776.255862:0:7483:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc3c80cc0 going to sleep for 11 seconds 00010000:00080000:1.0:1786400776.255981:0:7499:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6fee30e300 x1873176872108928/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1786400792 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400776.256012:0:7499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30e300 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7499:1873176872108928:0@lo:901: 00000100:00080000:0.0:1786400776.256928:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:3.0:1786400776.291390:0:5781:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1786400776.291408:0:5781:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1786400776.291442:0:5804:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1786400776.291447:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1786400776.291468:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1d7e3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400776.291498:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fe7d39800/0x5ccaaf4f3cb1d734 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d72d expref: 14 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400776.291506:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1d7e3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400776.291544:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fe7d39800/0x5ccaaf4f3cb1d734 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d72d expref: 14 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400776.291557:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fe7d39800/0x5ccaaf4f3cb1d734 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d72d expref: 14 pid: 5780 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400776.291571:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5804:1873176872109056:0@lo:104: 00000100:00100000:3.0:1786400776.291770:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400776.291850:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffccb7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1786400776.297440:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872109056 00000100:00100000:1.0:1786400776.297456:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872109056 00000100:00100000:1.0:1786400776.297523:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1786400776.297533:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:97b0324f-e214-4822-8711-e150ddac2a7e+3:5804:x1873176872109056:12345-0@lo:104: 00010000:00010000:1.0:1786400776.297552:0:5771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e600/0x5ccaaf4f3cb1d72d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d734 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400776.297958:0:5771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786400776.297966:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:97b0324f-e214-4822-8711-e150ddac2a7e+3:5804:x1873176872109056:12345-0@lo:104: Request processed in 435us (6197us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400776.297975:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1786400776.298048:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786400776.298065:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e600/0x5ccaaf4f3cb1d72d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d734 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400776.298074:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138e600 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:0.0:1786400776.298078:0:5776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e600/0x5ccaaf4f3cb1d72d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5ccaaf4f3cb1d734 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400776.298177:0:5776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e600/0x5ccaaf4f3cb1d72d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5ccaaf4f3cb1d734 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786400776.298186:0:5776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e600/0x5ccaaf4f3cb1d72d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5ccaaf4f3cb1d734 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786400776.298192:0:5776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1786400776.298232:0:5776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e600/0x5ccaaf4f3cb1d72d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d734 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400776.298239:0:5776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786400776.298259:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e600/0x5ccaaf4f3cb1d72d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d734 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400776.298265:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e600/0x5ccaaf4f3cb1d72d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d734 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400776.298296:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400776.298298:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400776.298300:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400776.298317:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:97b0324f-e214-4822-8711-e150ddac2a7e:3307:1873176872109184:0@lo:103: 00000100:00100000:0.0:1786400776.298497:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400776.298550:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872109184 00000100:00100000:0.0:1786400776.298555:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872109184 00010000:00010000:0.0:1786400776.298575:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fe7d39800/0x5ccaaf4f3cb1d734 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d72d expref: 15 pid: 5780 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400776.298676:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1786400776.298684:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc458b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:97b0324f-e214-4822-8711-e150ddac2a7e+15:3307:x1873176872109184:12345-0@lo:103: 00010000:00010000:0.0:1786400776.298696:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400776.298701:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fe7d39800/0x5ccaaf4f3cb1d734 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d72d expref: 15 pid: 5780 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400776.298712:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fe7d39800/0x5ccaaf4f3cb1d734 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d72d expref: 15 pid: 5780 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400776.298730:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1d7e3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400776.298738:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1d7e3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1786400776.298756:0:5774:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007308955s 00010000:00010000:0.0:1786400776.298760:0:5774:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1d7e3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400776.298779:0:5774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1d7e3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400776.298786:0:5774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1d7e3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400776.298791:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1d7e3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400776.298797:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7d38a00 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:0.0:1786400776.298802:0:5774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1d7e3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400776.298810:0:5774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1d7e3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400776.298819:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1d7e3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400776.298829:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400776.298861:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc458b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:97b0324f-e214-4822-8711-e150ddac2a7e+15:3307:x1873176872109184:12345-0@lo:103: Request processed in 178us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400776.298868:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1786400776.298931:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:97b0324f-e214-4822-8711-e150ddac2a7e:3307:1873176872109184:0@lo:103: 00010000:00010000:2.0:1786400776.299027:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe7d39800/0x5ccaaf4f3cb1d734 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d72d expref: 14 pid: 5780 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400776.299040:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5804:1873176872109056:0@lo:104: 00010000:00010000:2.0:1786400776.299056:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1d7e3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400776.299064:0:5804:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1d7e3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400776.299071:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1d7e3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400776.299077:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1d7e3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400776.299838:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+13:7483:x1873176872108800:12345-0@lo:253: Request processed in 46975us (47060us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400776.299849:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1786400776.299914:0:7483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:97b0324f-e214-4822-8711-e150ddac2a7e:7483:1873176872108800:0@lo:253: 10000000:01000000:1.0:1786400776.299926:0:7483:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1786400776.299929:0:7483:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1786400776.299931:0:7483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1786400776.299933:0:7483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786400776.299934:0:7483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786400776.299935:0:7483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786400776.299936:0:7483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786400776.299938:0:7483:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786400776.299939:0:7483:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1786400776.299941:0:7483:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1786400776.299943:0:7483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786400776.299944:0:7483:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1786400776.299960:0:7483:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1786400776.308543:0:7483:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1786400776.308788:0:7483:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1786400776.308969:0:7483:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1786400776.309179:0:7483:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1786400776.309400:0:7483:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1786400776.310367:0:7483:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1786400776.312575:0:7483:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1786400776.761321:0:7483:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1786400776.761342:0:7483:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1786400776.761376:0:7483:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1786400776.761431:0:7483:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.108@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1786400776.761446:0:7483:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1786400776.761506:0:7483:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1786400777.137017:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400778.160204:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400779.182288:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400780.211624:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400781.040311:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786400781.040338:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872109312:0@lo:13: 00000100:00100000:1.0:1786400781.040408:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400781.040477:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872109312 00000100:00100000:1.0:1786400781.040485:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872109312 00000100:00100000:1.0:1786400781.040543:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1786400781.040553:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872109312:12345-0@lo:13: 00002000:00000024:1.0:1786400781.040591:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400781.040637:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872109312:12345-0@lo:13: Request processed in 86us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400781.040645:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1786400781.040686:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fc97f6300 x1873176872109312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400797 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400781.040706:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872109312:0@lo:13: 00000100:00080000:2.0:1786400781.049775:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1786400781.236671:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1786400781.550226:0:5785:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1786400781.550245:0:5785:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d6fc49f0000 from 30 10000000:01000000:1.0:1786400781.550249:0:5785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1786400781.550282:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e800/0x5ccaaf4f3cb1d7ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400781.550287:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:97b0324f-e214-4822-8711-e150ddac2a7e:3309:1873176872109440:0@lo:400: 00010000:00010000:1.0:1786400781.550297:0:5785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e800/0x5ccaaf4f3cb1d7ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400781.550309:0:5785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e800/0x5ccaaf4f3cb1d7ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400781.550310:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873176872109952:0@lo:400: 00000100:00100000:1.0:1786400781.550323:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872109568:0@lo:101: 00000100:00100000:1.0:1786400781.551380:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400781.551438:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc56c00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786400781.551482:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872109568 00000100:00100000:0.0:1786400781.551489:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400781.551490:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400781.551490:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872109568 00000100:00100000:1.0:1786400781.551533:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872109440 00000100:00100000:1.0:1786400781.551543:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872109440 00000100:00100000:2.0:1786400781.551545:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872109696:0@lo:400: 00000100:00100000:0.0:1786400781.551550:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1786400781.551569:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1786400781.551577:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400781.551595:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786400781.551601:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872109824:0@lo:400: 00000100:00100000:2.0:1786400781.551703:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400781.551738:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872109952 00000100:00100000:2.0:1786400781.551742:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872109952 00000100:00100000:2.0:1786400781.551781:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872109696 00000100:00100000:2.0:1786400781.551785:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872109696 00000100:00100000:2.0:1786400781.551800:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872109824 00000100:00100000:2.0:1786400781.551803:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872109824 00000100:00100000:2.0:1786400781.552247:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1786400781.552256:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee30e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873176872109952:12345-0@lo:400: 00000100:00100000:2.0:1786400781.552315:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee30e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873176872109952:12345-0@lo:400: Request processed in 61us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400781.552321:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1786400781.552346:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1786400781.552353:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee30fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872109696:12345-0@lo:400: 00000100:00100000:2.0:1786400781.552389:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee30fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872109696:12345-0@lo:400: Request processed in 37us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400781.552394:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1786400781.552404:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1786400781.552410:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee30f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872109824:12345-0@lo:400: 00000100:00100000:2.0:1786400781.552433:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee30f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872109824:12345-0@lo:400: Request processed in 23us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400781.552439:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1786400781.552461:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400781.552653:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+14:5785:x1873176872109568:12345-0@lo:101: 00010000:00010000:0.0:1786400781.552667:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400781.552683:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fc0031000/0x5ccaaf4f3cb1d7f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d7ea expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400781.552708:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc0031000/0x5ccaaf4f3cb1d7f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d7ea expref: 15 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400781.552720:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fc0031000/0x5ccaaf4f3cb1d7f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d7ea expref: 15 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400781.552729:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc0031000, rc 0) 00000100:00100000:0.0:1786400781.552763:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+15:5785:x1873176872109568:12345-0@lo:101: Request processed in 1203us (1385us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400781.552770:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1786400781.552824:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872109568:0@lo:101: 00010000:00010000:0.0:1786400781.552840:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e800/0x5ccaaf4f3cb1d7ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d7f1 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400781.552860:0:5785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e800/0x5ccaaf4f3cb1d7ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d7f1 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400781.552919:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872110080:0@lo:501: 00000100:00100000:0.0:1786400781.552946:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400781.552967:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc4579e40 going to sleep for 11 seconds 00000100:00100000:0.0:1786400781.552978:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872110080 00000100:00100000:0.0:1786400781.552982:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872110080 00000100:00100000:1.0:1786400781.553986:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+15:3309:x1873176872109440:12345-0@lo:400: 00000100:00100000:1.0:1786400781.554053:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+15:3309:x1873176872109440:12345-0@lo:400: Request processed in 2476us (2568us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400781.554060:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1786400781.555329:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1786400781.555340:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+14:5785:x1873176872110080:12345-0@lo:501: 00010000:00080000:2.0:1786400781.555360:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fee30f800 x1873176872109824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400781.555376:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872109824:0@lo:400: 00010000:00080000:2.0:1786400781.555392:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fee30ce00 x1873176872109696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400781.555401:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872109696:0@lo:400: 00000100:00100000:0.0:1786400781.555681:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+14:5785:x1873176872110080:12345-0@lo:501: Request processed in 342us (2732us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400781.555689:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1786400781.555726:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872110080:0@lo:501: 00000100:00100000:0.0:1786400781.555764:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872110208:0@lo:503: 00000100:00100000:0.0:1786400781.555807:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400781.555833:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc4579e40 going to sleep for 11 seconds 00000100:00100000:0.0:1786400781.555846:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872110208 00000100:00100000:0.0:1786400781.555851:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872110208 00000100:00100000:0.0:1786400781.555871:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1786400781.555878:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+14:5785:x1873176872110208:12345-0@lo:503: 00000100:00100000:0.0:1786400781.556157:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+14:5785:x1873176872110208:12345-0@lo:503: Request processed in 279us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400781.556164:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1786400781.556194:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872110208:0@lo:503: 00000100:00100000:0.0:1786400781.556346:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:97b0324f-e214-4822-8711-e150ddac2a7e:3309:1873176872109440:0@lo:400: 00000100:00100000:0.0:1786400781.556436:0:7747:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:7747:1873176872110336:0@lo:502: 00000100:00100000:0.0:1786400781.556469:0:7747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400781.556488:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872110336 00000100:00100000:0.0:1786400781.556491:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872110336 00000100:00100000:0.0:1786400781.556512:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1786400781.556519:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+14:7747:x1873176872110336:12345-0@lo:502: 00000100:00100000:0.0:1786400781.556710:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+14:7747:x1873176872110336:12345-0@lo:502: Request processed in 191us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400781.556716:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1786400781.556749:0:7747:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc4579f00 going to sleep for 11 seconds 00000100:00100000:0.0:1786400781.556760:0:7747:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:7747:1873176872110336:0@lo:502: 00000100:00100000:0.0:1786400781.556794:0:7747:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:7747:1873176872110464:0@lo:502: 00000100:00100000:0.0:1786400781.556821:0:7747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400781.556837:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872110464 00000100:00100000:0.0:1786400781.556840:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872110464 00000100:00100000:0.0:1786400781.556861:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1786400781.556866:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+14:7747:x1873176872110464:12345-0@lo:502: 00000100:00100000:0.0:1786400781.556976:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+14:7747:x1873176872110464:12345-0@lo:502: Request processed in 109us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400781.556981:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1786400781.557004:0:7747:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc4579f00 going to sleep for 11 seconds 00000100:00100000:0.0:1786400781.557014:0:7747:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:7747:1873176872110464:0@lo:502: 00000040:00080000:0.0:1786400781.557030:0:7747:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1786400781.557073:0:5785:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1786400781.557117:0:5785:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1786400781.557127:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e800/0x5ccaaf4f3cb1d7ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d7f1 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400781.557137:0:5785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e800/0x5ccaaf4f3cb1d7ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d7f1 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786400781.557146:0:5785:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1786400781.557149:0:5785:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1786400781.557151:0:5785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1786400781.557173:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031a00/0x5ccaaf4f3cb1d7f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400781.557180:0:5785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031a00/0x5ccaaf4f3cb1d7f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400781.557188:0:5785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031a00/0x5ccaaf4f3cb1d7f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400781.557198:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872110592:0@lo:101: 00000100:00100000:0.0:1786400781.557222:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400781.557255:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc4579f00 going to sleep for 11 seconds 00000100:00100000:0.0:1786400781.557270:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872110592 00000100:00100000:0.0:1786400781.557274:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872110592 00000100:00100000:0.0:1786400781.557299:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1786400781.557305:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+14:5785:x1873176872110592:12345-0@lo:101: 00010000:00010000:0.0:1786400781.557313:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400781.557323:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fc0030800/0x5ccaaf4f3cb1d7ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d7f8 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400781.557352:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc0030800/0x5ccaaf4f3cb1d7ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d7f8 expref: 15 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400781.557362:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fc0030800/0x5ccaaf4f3cb1d7ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d7f8 expref: 15 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400781.557371:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc0030800, rc 0) 00000100:00100000:0.0:1786400781.557398:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+15:5785:x1873176872110592:12345-0@lo:101: Request processed in 94us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400781.557403:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1786400781.557430:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872110592:0@lo:101: 00010000:00010000:0.0:1786400781.557441:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031a00/0x5ccaaf4f3cb1d7f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d7ff expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400781.557449:0:5785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031a00/0x5ccaaf4f3cb1d7f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d7ff expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400781.557485:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872110720:0@lo:501: 00000100:00100000:0.0:1786400781.557513:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400781.557526:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc4579f00 going to sleep for 11 seconds 00000100:00100000:0.0:1786400781.557539:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872110720 00000100:00100000:0.0:1786400781.557543:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872110720 00000100:00100000:0.0:1786400781.557565:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1786400781.557571:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+15:5785:x1873176872110720:12345-0@lo:501: 00000100:00100000:0.0:1786400781.557750:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+15:5785:x1873176872110720:12345-0@lo:501: Request processed in 179us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400781.557757:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1786400781.557796:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872110720:0@lo:501: 00000100:00100000:0.0:1786400781.557820:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872110848:0@lo:503: 00000100:00100000:0.0:1786400781.557850:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400781.557865:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc4579f00 going to sleep for 11 seconds 00000100:00100000:0.0:1786400781.557879:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872110848 00000100:00100000:0.0:1786400781.557882:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872110848 00000100:00100000:0.0:1786400781.557916:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1786400781.557923:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+15:5785:x1873176872110848:12345-0@lo:503: 00010000:00080000:2.0:1786400781.558002:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fee30dc00 x1873176872109952/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400781.558016:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873176872109952:0@lo:400: 00000100:00100000:0.0:1786400781.561604:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+15:5785:x1873176872110848:12345-0@lo:503: Request processed in 3671us (3742us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400781.561621:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1786400781.561761:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872110848:0@lo:503: 00000100:00100000:2.0:1786400781.561981:0:7748:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:7748:1873176872110976:0@lo:502: 00000100:00100000:2.0:1786400781.562024:0:7748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400781.562053:0:7748:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffccb7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400781.562130:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872110976 00000100:00100000:0.0:1786400781.562137:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872110976 00000100:00100000:0.0:1786400781.562283:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1786400781.562293:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+15:7748:x1873176872110976:12345-0@lo:502: 00000100:00100000:0.0:1786400781.562494:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+15:7748:x1873176872110976:12345-0@lo:502: Request processed in 202us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400781.562501:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1786400781.562578:0:7748:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:7748:1873176872110976:0@lo:502: 00000020:01000000:2.0:1786400781.562599:0:7748:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786400781.562608:0:7748:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786400781.562610:0:7748:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1786400781.562615:0:7748:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1786400781.562617:0:7748:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1786400781.562632:0:7748:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:7748:1873176872111104:0@lo:502: 00000100:00100000:2.0:1786400781.562664:0:7748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400781.562684:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872111104 00000100:00100000:2.0:1786400781.562688:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872111104 00000100:00100000:2.0:1786400781.562707:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1786400781.562713:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+15:7748:x1873176872111104:12345-0@lo:502: 00000100:00100000:2.0:1786400781.562819:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+15:7748:x1873176872111104:12345-0@lo:502: Request processed in 106us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400781.562826:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1786400781.562857:0:7748:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffccb7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400781.562867:0:7748:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:7748:1873176872111104:0@lo:502: 00000020:01000000:2.0:1786400781.562882:0:7748:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786400781.562886:0:7748:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786400781.562888:0:7748:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1786400781.562891:0:7748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1786400781.562944:0:5785:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1786400781.562964:0:5785:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1786400781.562973:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031a00/0x5ccaaf4f3cb1d7f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d7ff expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400781.562983:0:5785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031a00/0x5ccaaf4f3cb1d7f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d7ff expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786400781.563001:0:5785:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1786400781.563004:0:5785:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d6fc307d800 from 30 10000000:01000000:2.0:1786400781.563007:0:5785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1786400781.563029:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fca091400/0x5ccaaf4f3cb1d806 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400781.563038:0:5785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fca091400/0x5ccaaf4f3cb1d806 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400781.563046:0:5785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fca091400/0x5ccaaf4f3cb1d806 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400781.563057:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872111232:0@lo:101: 00000100:00100000:2.0:1786400781.563081:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400781.563116:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffccb7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400781.563127:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872111232 00000100:00100000:2.0:1786400781.563130:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872111232 00000100:00100000:2.0:1786400781.563148:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1786400781.563154:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+15:5785:x1873176872111232:12345-0@lo:101: 00010000:00010000:2.0:1786400781.563161:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400781.563172:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fca090e00/0x5ccaaf4f3cb1d80d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d806 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400781.563190:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fca090e00/0x5ccaaf4f3cb1d80d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d806 expref: 16 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400781.563200:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fca090e00/0x5ccaaf4f3cb1d80d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d806 expref: 16 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400781.563221:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca090e00, rc 0) 00000100:00100000:2.0:1786400781.563262:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+16:5785:x1873176872111232:12345-0@lo:101: Request processed in 108us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400781.563268:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1786400781.563299:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872111232:0@lo:101: 00010000:00010000:2.0:1786400781.563309:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fca091400/0x5ccaaf4f3cb1d806 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d80d expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400781.563318:0:5785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fca091400/0x5ccaaf4f3cb1d806 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d80d expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400781.563355:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872111360:0@lo:501: 00000100:00100000:2.0:1786400781.563377:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400781.563389:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffccb7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400781.563400:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872111360 00000100:00100000:2.0:1786400781.563403:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872111360 00000100:00100000:2.0:1786400781.563419:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1786400781.563424:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+16:5785:x1873176872111360:12345-0@lo:501: 00000100:00100000:2.0:1786400781.563628:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+16:5785:x1873176872111360:12345-0@lo:501: Request processed in 203us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400781.563633:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1786400781.563660:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872111360:0@lo:501: 00000100:00100000:2.0:1786400781.563681:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872111488:0@lo:503: 00000100:00100000:2.0:1786400781.563715:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400781.563728:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffccb7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400781.563746:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872111488 00000100:00100000:2.0:1786400781.563750:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872111488 00000100:00100000:2.0:1786400781.563765:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1786400781.563771:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+16:5785:x1873176872111488:12345-0@lo:503: 00000100:00100000:2.0:1786400781.563894:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+16:5785:x1873176872111488:12345-0@lo:503: Request processed in 122us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400781.563899:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1786400781.563931:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872111488:0@lo:503: 00000100:00100000:2.0:1786400781.567768:0:7749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:7749:1873176872111616:0@lo:502: 00000100:00100000:2.0:1786400781.567838:0:7749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400781.567869:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872111616 00000100:00100000:2.0:1786400781.567876:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872111616 00000100:00100000:2.0:1786400781.567912:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1786400781.567919:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+16:7749:x1873176872111616:12345-0@lo:502: 00000100:00100000:2.0:1786400781.568134:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+16:7749:x1873176872111616:12345-0@lo:502: Request processed in 214us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400781.568142:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1786400781.568181:0:7749:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffccb7780 going to sleep for 11 seconds 00000100:00100000:2.0:1786400781.568199:0:7749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:7749:1873176872111616:0@lo:502: 00000100:00100000:2.0:1786400781.568254:0:7749:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:7749:1873176872111744:0@lo:502: 00000100:00100000:2.0:1786400781.568281:0:7749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400781.568290:0:7749:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffccb7780 going to sleep for 11 seconds 00000100:00100000:0.0:1786400781.568349:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872111744 00000100:00100000:0.0:1786400781.568353:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872111744 00000100:00100000:0.0:1786400781.568381:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1786400781.568388:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+16:7749:x1873176872111744:12345-0@lo:502: 00000100:00100000:0.0:1786400781.568500:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+16:7749:x1873176872111744:12345-0@lo:502: Request processed in 112us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400781.568506:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1786400781.568573:0:7749:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:7749:1873176872111744:0@lo:502: 00000040:00080000:2.0:1786400781.568588:0:7749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1786400781.568742:0:5785:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1786400781.568760:0:5785:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1786400781.568774:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fca091400/0x5ccaaf4f3cb1d806 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d80d expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400781.568785:0:5785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fca091400/0x5ccaaf4f3cb1d806 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d80d expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786400781.568793:0:5785:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1786400781.568796:0:5785:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9d6fc307d800 from 5 10000000:01000000:0.0:1786400781.568798:0:5785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1786400781.568820:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc0030e00/0x5ccaaf4f3cb1d814 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400781.568828:0:5785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fc0030e00/0x5ccaaf4f3cb1d814 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400781.568838:0:5785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fc0030e00/0x5ccaaf4f3cb1d814 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400781.568849:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872111872:0@lo:101: 00000100:00100000:0.0:1786400781.568872:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400781.568889:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fcb3a60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400781.568898:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872111872 00000100:00100000:0.0:1786400781.568901:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872111872 00000100:00100000:0.0:1786400781.568917:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1786400781.568922:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+16:5785:x1873176872111872:12345-0@lo:101: 00010000:00010000:0.0:1786400781.568929:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400781.568938:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fc0031600/0x5ccaaf4f3cb1d81b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d814 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400781.568956:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc0031600/0x5ccaaf4f3cb1d81b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d814 expref: 17 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400781.568971:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fc0031600/0x5ccaaf4f3cb1d81b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d814 expref: 17 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400781.568980:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc0031600, rc 0) 00000100:00100000:0.0:1786400781.569002:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+17:5785:x1873176872111872:12345-0@lo:101: Request processed in 80us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400781.569007:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1786400781.569030:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872111872:0@lo:101: 00010000:00010000:0.0:1786400781.569039:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fc0030e00/0x5ccaaf4f3cb1d814 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d81b expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400781.569047:0:5785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fc0030e00/0x5ccaaf4f3cb1d814 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d81b expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400781.569081:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872112000:0@lo:256: 00000100:00100000:0.0:1786400781.569133:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400781.569146:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fcb3a60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400781.569156:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872112000 00000100:00100000:0.0:1786400781.569159:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872112000 00000100:00100000:0.0:1786400781.569176:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1786400781.569181:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+17:5785:x1873176872112000:12345-0@lo:256: 20000000:01000000:0.0:1786400781.569191:0:5780:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1786400781.569207:0:5780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1786400781.569210:0:5780:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1786400781.569278:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+17:5785:x1873176872112000:12345-0@lo:256: Request processed in 97us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400781.569285:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1786400781.569312:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872112000:0@lo:256: 10000000:01000000:0.0:1786400781.569343:0:5785:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1786400781.569348:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc0030e00/0x5ccaaf4f3cb1d814 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d81b expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400781.569355:0:5785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fc0030e00/0x5ccaaf4f3cb1d814 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d81b expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786400781.569361:0:5785:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1786400781.569363:0:5785:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1786400781.569365:0:5785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1786400781.569376:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031c00/0x5ccaaf4f3cb1d822 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400781.569383:0:5785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031c00/0x5ccaaf4f3cb1d822 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400781.569389:0:5785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031c00/0x5ccaaf4f3cb1d822 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400781.569400:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872112128:0@lo:101: 00000100:00100000:0.0:1786400781.569420:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400781.569429:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fcb3a60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400781.569438:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872112128 00000100:00100000:0.0:1786400781.569440:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872112128 00000100:00100000:0.0:1786400781.569455:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1786400781.569460:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+17:5785:x1873176872112128:12345-0@lo:101: 00010000:00010000:0.0:1786400781.569466:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400781.569472:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d70020e5200/0x5ccaaf4f3cb1d829 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d822 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400781.569490:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d70020e5200/0x5ccaaf4f3cb1d829 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d822 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400781.569498:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d70020e5200/0x5ccaaf4f3cb1d829 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d822 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400781.569505:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d70020e5200, rc 0) 00000100:00100000:0.0:1786400781.569525:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+18:5785:x1873176872112128:12345-0@lo:101: Request processed in 66us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400781.569531:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1786400781.569553:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872112128:0@lo:101: 00010000:00010000:0.0:1786400781.569561:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031c00/0x5ccaaf4f3cb1d822 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d829 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400781.569569:0:5785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031c00/0x5ccaaf4f3cb1d822 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d829 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400781.569600:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872112256:0@lo:501: 00000100:00100000:0.0:1786400781.569618:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400781.569627:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fcb3a60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400781.569634:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872112256 00000100:00100000:0.0:1786400781.569637:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872112256 00000100:00100000:0.0:1786400781.569651:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1786400781.569656:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+18:5785:x1873176872112256:12345-0@lo:501: 00000100:00100000:0.0:1786400781.569877:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+18:5785:x1873176872112256:12345-0@lo:501: Request processed in 220us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400781.569882:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1786400781.569919:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872112256:0@lo:501: 00000100:00100000:0.0:1786400781.569944:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872112384:0@lo:503: 00000100:00100000:0.0:1786400781.569975:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400781.569987:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fcb3a60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400781.569997:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872112384 00000100:00100000:0.0:1786400781.570000:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872112384 00000100:00100000:0.0:1786400781.570017:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1786400781.570022:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+18:5785:x1873176872112384:12345-0@lo:503: 00000100:00100000:0.0:1786400781.570324:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+18:5785:x1873176872112384:12345-0@lo:503: Request processed in 300us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400781.570330:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1786400781.570362:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872112384:0@lo:503: 00000100:00100000:3.0:1786400781.576687:0:7750:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:7750:1873176872112512:0@lo:502: 00000100:00100000:3.0:1786400781.576763:0:7750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400781.576860:0:7750:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc9c7e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786400781.578411:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872112512 00000100:00100000:1.0:1786400781.578423:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872112512 00000100:00100000:1.0:1786400781.578889:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1786400781.578901:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+18:7750:x1873176872112512:12345-0@lo:502: 00000100:00100000:1.0:1786400781.579280:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+18:7750:x1873176872112512:12345-0@lo:502: Request processed in 381us (2517us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400781.579288:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1786400781.579389:0:7750:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:7750:1873176872112512:0@lo:502: 00000020:01000000:0.0:1786400781.579423:0:7750:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1786400781.579431:0:7750:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1786400781.579438:0:7750:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786400781.579440:0:7750:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1786400781.579445:0:7750:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1786400781.582481:0:7750:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.108@tcp to nid 0x20000c0a8cc6c (192.168.204.108@tcp) 00000020:01000000:0.0:1786400781.582530:0:7750:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1786400781.582537:0:7750:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1786400781.582554:0:7750:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9d6fc33f19c0) 00000020:00000080:0.0:1786400781.582576:0:7750:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1786400781.582583:0:7750:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1786400781.582688:0:7750:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1786400781.582694:0:7750:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:0.0:1786400781.582701:0:7750:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5ccaaf4f3cb1d837 00010000:00080000:0.0:1786400781.582737:0:7750:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d6fc4811000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.108@tcp at head 00010000:00010000:0.0:1786400781.582956:0:7750:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1786400781.583338:0:7750:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1786400781.583352:0:7750:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1786400781.583863:0:7750:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1786400781.584079:0:7750:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1786400781.584156:0:7750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1786400781.584216:0:7750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1786400781.587724:0:7756:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786400781.587731:0:7756:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1786400781.588366:0:7750:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1786400781.588379:0:7750:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1786400781.588408:0:7750:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1786400781.588429:0:7750:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5ccaaf4f3cb1d83e 00000100:00080000:0.0:1786400781.588440:0:7750:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1786400781.588446:0:7750:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d6fc4811000 using connection 192.168.204.108@tcp/0@lo 00000100:00100000:0.0:1786400781.588480:0:7750:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d7000dd5f80 x1873176872112640/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786400781.588505:0:7750:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1786400781.588552:0:7750:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786400781.588556:0:7750:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786400781.588558:0:7750:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1786400781.588561:0:7750:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786400781.588565:0:7750:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786400781.588566:0:7750:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1786400781.588570:0:7750:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1786400781.588571:0:7750:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1786400781.588597:0:7750:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:7750:1873176872112768:0@lo:502: 00000100:00100000:0.0:1786400781.588669:0:7750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400781.588700:0:7750:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fcb340000 going to sleep for 11 seconds 00000100:00100000:3.0:1786400781.588784:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872112768 00000100:00100000:3.0:1786400781.588790:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872112768 00000100:00100000:3.0:1786400781.588837:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1786400781.588846:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+18:7750:x1873176872112768:12345-0@lo:502: 00000100:00100000:3.0:1786400781.589059:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+18:7750:x1873176872112768:12345-0@lo:502: Request processed in 213us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400781.589066:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1786400781.589212:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873176872112640:0@lo:8: 00000100:00100000:2.0:1786400781.589256:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400781.589348:0:7750:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:7750:1873176872112768:0@lo:502: 00000020:01000000:0.0:1786400781.589375:0:7750:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786400781.589383:0:7750:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786400781.589385:0:7750:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1786400781.589389:0:7750:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:3.0:1786400781.589561:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872112640 00000100:00100000:3.0:1786400781.589566:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872112640 00000100:00100000:3.0:1786400781.589838:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1786400781.589852:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee30dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1873176872112640:12345-0@lo:8: 00010000:00080000:3.0:1786400781.589875:0:6592:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:3.0:1786400781.589904:0:6592:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5ccaaf4f3cb1d845 00002000:00100000:3.0:1786400781.589916:0:6592:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9d6ec470f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1786400781.589921:0:6592:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1786400781.589925:0:6592:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1786400781.590035:0:6592:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1786400781.590205:0:6592:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1786400781.590228:0:6592:0:(import.c:65:import_set_state_nolock()) ffff9d6ec4708000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786400781.590294:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee30dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1873176872112640:12345-0@lo:8: Request processed in 442us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400781.590302:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1786400781.590341:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d7000dd5f80 x1873176872112640/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1786400791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400781.590351:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1786400781.590358:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1786400781.590366:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1786400781.590371:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1786400781.590373:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9d6fc4811000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1786400781.590388:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1786400781.590394:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873176872112640:0@lo:8: 00000020:01000000:2.0:1786400781.591047:0:5785:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1786400781.591073:0:5785:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1786400781.591095:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031c00/0x5ccaaf4f3cb1d822 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d829 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400781.591108:0:5785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031c00/0x5ccaaf4f3cb1d822 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d829 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786400781.591118:0:5785:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1786400781.591120:0:5785:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9d6fc523cd40 from 1 10000000:01000000:2.0:1786400781.591123:0:5785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1786400781.591150:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fca091200/0x5ccaaf4f3cb1d84c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400781.591158:0:5785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fca091200/0x5ccaaf4f3cb1d84c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400781.591168:0:5785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fca091200/0x5ccaaf4f3cb1d84c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400781.591184:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872112896:0@lo:101: 00000100:00100000:2.0:1786400781.591220:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400781.591258:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffccb7cc0 going to sleep for 11 seconds 00000004:00080000:2.0:1786400781.591271:0:7756:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1786400781.591385:0:7756:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 233992298366ns, next at 0ns, rc = 0 00000100:00100000:1.0:1786400781.591909:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872112896 00000100:00100000:1.0:1786400781.591917:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872112896 00000100:00100000:1.0:1786400781.591952:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1786400781.591961:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+18:5785:x1873176872112896:12345-0@lo:101: 00010000:00010000:1.0:1786400781.591973:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400781.591986:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fc138e400/0x5ccaaf4f3cb1d853 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d84c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400781.592008:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc138e400/0x5ccaaf4f3cb1d853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d84c expref: 19 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400781.592018:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fc138e400/0x5ccaaf4f3cb1d853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d84c expref: 19 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400781.592027:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138e400, rc 0) 00000100:00100000:1.0:1786400781.592068:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+19:5785:x1873176872112896:12345-0@lo:101: Request processed in 107us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400781.592081:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1786400781.592143:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872112896:0@lo:101: 00010000:00010000:1.0:1786400781.592154:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fca091200/0x5ccaaf4f3cb1d84c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d853 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400781.592164:0:5785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fca091200/0x5ccaaf4f3cb1d84c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d853 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400781.592206:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872113024:0@lo:501: 00000100:00100000:1.0:1786400781.592245:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400781.592264:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffa3aee40 going to sleep for 11 seconds 00000100:00100000:2.0:1786400781.596164:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872113024 00000100:00100000:2.0:1786400781.596178:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872113024 00000100:00100000:2.0:1786400781.596319:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1786400781.596337:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+19:5785:x1873176872113024:12345-0@lo:501: 00000100:00100000:2.0:1786400781.596591:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+19:5785:x1873176872113024:12345-0@lo:501: Request processed in 256us (4357us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786400781.596600:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1786400781.600278:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872113024:0@lo:501: 10000000:01000000:1.0:1786400781.600323:0:5785:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1786400781.600334:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fca091200/0x5ccaaf4f3cb1d84c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d853 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400781.600346:0:5785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fca091200/0x5ccaaf4f3cb1d84c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d853 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786400781.668396:0:7757:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1786400781.668426:0:7757:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7757:1873176872113280:0@lo:7: 00000100:00100000:3.0:1786400781.668498:0:7757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400781.668544:0:7757:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc343e300 going to sleep for 11 seconds 00000100:00100000:0.0:1786400781.668676:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872113152:0@lo:13: 00000100:00100000:0.0:1786400781.668714:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400781.669331:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872113152 00000100:00100000:3.0:1786400781.669345:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872113152 00000100:00100000:3.0:1786400781.669403:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1786400781.669411:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d7000dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1873176872113152:12345-0@lo:13: 00002000:00000024:3.0:1786400781.669443:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1786400781.669501:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d7000dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1873176872113152:12345-0@lo:13: Request processed in 90us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400781.669508:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1786400781.669583:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff692f480 x1873176872113152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400797 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400781.669600:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872113152:0@lo:13: 00000100:00100000:1.0:1786400781.672187:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872113280 00000100:00100000:1.0:1786400781.672290:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872113280 00000100:00100000:1.0:1786400781.672350:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1786400781.672359:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7757:x1873176872113280:12345-0@lo:7: 00000100:00080000:2.0:1786400781.674355:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:1.0:1786400781.679938:0:6593:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1786400781.679946:0:6593:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1786400781.680047:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7757:x1873176872113280:12345-0@lo:7: Request processed in 7685us (11544us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400781.680067:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1786400781.680329:0:7757:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff692e300 x1873176872113280/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1786400797 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400781.680345:0:7757:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7757:1873176872113280:0@lo:7: 00000004:00080000:2.0:1786400781.680361:0:7757:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1786400781.680399:0:7757:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7757:1873176872113408:0@lo:5: 00000100:00100000:2.0:1786400781.680434:0:7757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400781.680474:0:7757:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc38a5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400781.681128:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872113408 00000100:00100000:0.0:1786400781.681135:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872113408 00000100:00100000:0.0:1786400781.681296:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1786400781.681306:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee30d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7757:x1873176872113408:12345-0@lo:5: 00002000:00080000:0.0:1786400781.681334:0:6590:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1786400781.681338:0:6590:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1786400781.681657:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee30d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7757:x1873176872113408:12345-0@lo:5: Request processed in 351us (1221us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1786400781.681664:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1786400781.681770:0:7757:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fee30f800 x1873176872113408/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1786400797 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400781.681784:0:7757:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7757:1873176872113408:0@lo:5: 00000004:00080000:2.0:1786400781.681795:0:7757:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1786400781.681826:0:7757:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7757:1873176872113536:0@lo:700: 00000100:00100000:2.0:1786400781.681856:0:7757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400781.681874:0:7757:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc38a5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786400781.681949:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872113536 00000100:00100000:3.0:1786400781.681954:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872113536 00000100:00100000:3.0:1786400781.681990:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1786400781.681998:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee30d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7757:x1873176872113536:12345-0@lo:700: 00000100:00100000:3.0:1786400781.682038:0:6599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6599:1873176872113664:0@lo:700: 00000100:00100000:3.0:1786400781.682073:0:6599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400781.682120:0:6599:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d7000f21840 going to sleep for 11 seconds 00000100:00100000:1.0:1786400781.682309:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872113664 00000100:00100000:1.0:1786400781.682314:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872113664 00000100:00100000:1.0:1786400781.682352:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786400781.682360:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6599:x1873176872113664:12345-0@lo:700: 00000004:00080000:1.0:1786400781.704616:0:5810:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:0.0:1786400781.732219:0:5795:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1786400781.737414:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6599:x1873176872113664:12345-0@lo:700: Request processed in 55047us (55332us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400781.737429:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1786400781.737509:0:6599:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff692ed80 x1873176872113664/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1786400797 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400781.737526:0:6599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6599:1873176872113664:0@lo:700: 40000000:02000000:3.0:1786400781.737539:0:6599:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:1.0:1786400781.802445:0:7501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1786400781.802470:0:7501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1786400781.802646:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee30d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7757:x1873176872113536:12345-0@lo:700: Request processed in 120643us (120783us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400781.802660:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1786400781.802742:0:7757:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fee30e680 x1873176872113536/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1786400797 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400781.802753:0:7757:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1786400781.802771:0:7757:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7757:1873176872113536:0@lo:700: 00000004:02000040:0.0:1786400781.829979:0:7757:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1786400781.835706:0:7757:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7757:1873176872113792:0@lo:5: 00000100:00100000:0.0:1786400781.835779:0:7757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400781.835846:0:7757:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc9c7ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1786400781.836027:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872113792 00000100:00100000:1.0:1786400781.836036:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872113792 00000100:00100000:1.0:1786400781.836110:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1786400781.836120:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d7000dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7757:x1873176872113792:12345-0@lo:5: 00002000:00080000:0.0:1786400781.847036:0:6593:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1786400781.847056:0:6593:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1786400781.850665:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d7000dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7757:x1873176872113792:12345-0@lo:5: Request processed in 14539us (14879us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1786400781.850678:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1786400781.850731:0:7757:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d7000dd5f80 x1873176872113792/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1786400797 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400781.850747:0:7757:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7757:1873176872113792:0@lo:5: 00000004:00080000:0.0:1786400781.850762:0:7757:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1786400782.256824:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400783.278259:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1786400783.431186:0:7848:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg408-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1786400784.308937:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400785.328125:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400786.158388:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872113920:0@lo:13: 00000100:00100000:2.0:1786400786.158465:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400786.158621:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872113920 00000100:00100000:3.0:1786400786.158630:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872113920 00000100:00080000:2.0:1786400786.158684:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786400786.158706:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1786400786.158717:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee30e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872113920:12345-0@lo:13: 00002000:00000024:3.0:1786400786.158752:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786400786.158812:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee30e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872113920:12345-0@lo:13: Request processed in 97us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400786.158819:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1786400786.158918:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fc97f6a00 x1873176872113920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400802 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400786.158936:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872113920:0@lo:13: 00010000:00010000:2.0:1786400786.350999:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400786.670524:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872114048:0@lo:13: 00000100:00100000:3.0:1786400786.670602:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400786.670880:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872114048 00000100:00100000:0.0:1786400786.670888:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872114048 00000100:00100000:0.0:1786400786.670939:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1786400786.670949:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1873176872114048:12345-0@lo:13: 00002000:00000024:0.0:1786400786.670982:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1786400786.672881:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786400786.672906:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872114432:0@lo:400: 00000100:00100000:2.0:1786400786.672975:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400786.673024:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872114432 00000100:00100000:2.0:1786400786.673031:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872114432 00000100:00100000:2.0:1786400786.673272:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1786400786.673285:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee30f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872114432:12345-0@lo:400: 00000100:00100000:2.0:1786400786.673334:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee30f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872114432:12345-0@lo:400: Request processed in 54us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400786.673342:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1786400786.673418:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1873176872114048:12345-0@lo:13: Request processed in 2469us (2814us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400786.673427:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1786400786.673436:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873176872114304:0@lo:400: 00000100:00100000:1.0:1786400786.673471:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400786.673497:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1786400786.673505:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:97b0324f-e214-4822-8711-e150ddac2a7e:3309:1873176872114176:0@lo:400: 00000100:00100000:0.0:1786400786.673871:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872114304 00000100:00100000:0.0:1786400786.673876:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872114304 00000100:00100000:0.0:1786400786.673901:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1786400786.673907:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873176872114304:12345-0@lo:400: 00000100:00100000:0.0:1786400786.673941:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873176872114304:12345-0@lo:400: Request processed in 34us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400786.673947:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1786400786.673981:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400786.674036:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400786.674065:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873176872114688:0@lo:400: 00000100:00100000:1.0:1786400786.674121:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1786400786.674165:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fc97f5880 x1873176872114304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400786.674179:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873176872114304:0@lo:400: 00000100:00100000:1.0:1786400786.674204:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872114176 00000100:00100000:1.0:1786400786.674208:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872114176 00000100:00100000:1.0:1786400786.674254:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1786400786.674260:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+19:3309:x1873176872114176:12345-0@lo:400: 00010000:00080000:3.0:1786400786.674304:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d7000dd5500 x1873176872114048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400802 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400786.674322:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872114048:0@lo:13: 00000100:00100000:3.0:1786400786.674338:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872114560:0@lo:400: 00000100:00100000:3.0:1786400786.674366:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400786.674396:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872114560 00000100:00100000:3.0:1786400786.674400:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872114560 00000100:00100000:3.0:1786400786.674430:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1786400786.674437:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872114560:12345-0@lo:400: 00000100:00100000:3.0:1786400786.674471:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872114560:12345-0@lo:400: Request processed in 35us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400786.674477:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1786400786.674506:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fc97f5180 x1873176872114560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400786.674516:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872114560:0@lo:400: 00000100:00100000:3.0:1786400786.674542:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872114688 00000100:00100000:3.0:1786400786.674545:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872114688 00000100:00100000:3.0:1786400786.674566:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1786400786.674572:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873176872114688:12345-0@lo:400: 00000100:00080000:2.0:1786400786.674838:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1786400786.674891:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fc97f7b80 x1873176872114432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400786.674901:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872114432:0@lo:400: 00000100:00100000:3.0:1786400786.675340:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873176872114688:12345-0@lo:400: Request processed in 766us (1218us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400786.675435:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1786400786.675662:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+19:3309:x1873176872114176:12345-0@lo:400: Request processed in 1400us (1625us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400786.675673:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1786400786.676174:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:97b0324f-e214-4822-8711-e150ddac2a7e:3309:1873176872114176:0@lo:400: 00010000:00080000:0.0:1786400786.676203:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fc97f6a00 x1873176872114688/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400786.676213:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873176872114688:0@lo:400: 00000001:00080000:1.0:1786400787.300521:0:7501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1786400787.376522:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400788.398438:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400789.428258:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400790.446413:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400790.964555:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400790.965584:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850071936 00000100:00100000:1.0:1786400790.965597:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850071936 00000100:00100000:1.0:1786400790.965644:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 111 00000100:00100000:1.0:1786400790.965652:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2361:x1873176850071936:12345-192.168.204.8@tcp:250: 00010000:00080000:1.0:1786400790.965678:0:5780:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 6ee3c8da-45b0-4b79-a1d4-46386550e92b@192.168.204.8@tcp t0 exp 0000000000000000 cur 243 last 0 00000020:00000080:1.0:1786400790.965704:0:5780:0:(genops.c:1406:class_connect()) connect: client 6ee3c8da-45b0-4b79-a1d4-46386550e92b, cookie 0x5ccaaf4f3cb1d85a 00000100:00080000:1.0:1786400790.965835:0:5780:0:(import.c:65:import_set_state_nolock()) ffff9d6fc329a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786400790.965900:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+5:2361:x1873176850071936:12345-192.168.204.8@tcp:250: Request processed in 248us (1367us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400790.965908:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 111 00000100:00100000:1.0:1786400790.970614:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400790.971160:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850071808 00000100:00100000:2.0:1786400790.971170:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850071808 00000100:00100000:2.0:1786400790.971491:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 112 00000100:00100000:2.0:1786400790.971504:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+5:5566:x1873176850071808:12345-192.168.204.8@tcp:101: 00010000:00010000:2.0:1786400790.971522:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400790.971550:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fca091600/0x5ccaaf4f3cb1d861 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6ba07 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400790.971579:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fca091600/0x5ccaaf4f3cb1d861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba07 expref: 6 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400790.971611:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fca091600/0x5ccaaf4f3cb1d861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba07 expref: 6 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400790.971620:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca091600, rc 0) 00000100:00100000:2.0:1786400790.971813:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+6:5566:x1873176850071808:12345-192.168.204.8@tcp:101: Request processed in 312us (1209us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400790.971820:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 112 00000100:00100000:3.0:1786400790.974760:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400790.975282:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850072064 00000100:00100000:2.0:1786400790.975296:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850072064 00000100:00100000:2.0:1786400790.975731:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 113 00000100:00100000:2.0:1786400790.975744:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+6:5566:x1873176850072064:12345-192.168.204.8@tcp:501: 00000100:00100000:2.0:1786400790.976189:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+6:5566:x1873176850072064:12345-192.168.204.8@tcp:501: Request processed in 447us (1435us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786400790.976198:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 113 00000100:00100000:0.0:1786400790.981628:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400790.982129:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850072192 00000100:00100000:2.0:1786400790.982143:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850072192 00000100:00100000:2.0:1786400790.982227:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 114 00000100:00100000:2.0:1786400790.982239:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+6:5566:x1873176850072192:12345-192.168.204.8@tcp:101: 00010000:00010000:2.0:1786400790.982261:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400790.982286:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fca090400/0x5ccaaf4f3cb1d868 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6ba0e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400790.982324:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fca090400/0x5ccaaf4f3cb1d868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba0e expref: 7 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400790.982338:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fca090400/0x5ccaaf4f3cb1d868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba0e expref: 7 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400790.982369:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca090400, rc 0) 00000100:00100000:2.0:1786400790.982451:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+7:5566:x1873176850072192:12345-192.168.204.8@tcp:101: Request processed in 213us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400790.983795:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 114 00000100:00100000:3.0:1786400790.989000:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400790.989662:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850072320 00000100:00100000:2.0:1786400790.989678:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850072320 00000100:00100000:2.0:1786400790.991034:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 115 00000100:00100000:2.0:1786400790.991073:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+7:5566:x1873176850072320:12345-192.168.204.8@tcp:501: 00000100:00100000:2.0:1786400790.992660:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+8:5566:x1873176850072320:12345-192.168.204.8@tcp:501: Request processed in 1598us (3662us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400790.992678:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 115 00000100:00100000:3.0:1786400791.001158:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400791.002132:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850072448 00000100:00100000:2.0:1786400791.002149:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850072448 00000100:00100000:2.0:1786400791.002661:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 116 00000100:00100000:2.0:1786400791.002679:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+8:5566:x1873176850072448:12345-192.168.204.8@tcp:503: 00000100:00100000:2.0:1786400791.003905:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+8:5566:x1873176850072448:12345-192.168.204.8@tcp:503: Request processed in 1222us (2753us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400791.003920:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 116 00000100:00100000:0.0:1786400791.009361:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400791.009688:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850072576 00000100:00100000:2.0:1786400791.009700:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850072576 00000100:00100000:2.0:1786400791.009844:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 117 00000100:00100000:2.0:1786400791.009858:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+8:5585:x1873176850072576:12345-192.168.204.8@tcp:502: 00000100:00100000:2.0:1786400791.010528:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+8:5585:x1873176850072576:12345-192.168.204.8@tcp:502: Request processed in 603us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400791.010554:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 117 00000100:00100000:3.0:1786400791.058941:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400791.059190:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850072704 00000100:00100000:2.0:1786400791.059205:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850072704 00000100:00100000:2.0:1786400791.059908:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 118 00000100:00100000:2.0:1786400791.059926:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+8:5585:x1873176850072704:12345-192.168.204.8@tcp:502: 00000100:00100000:2.0:1786400791.062015:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+8:5585:x1873176850072704:12345-192.168.204.8@tcp:502: Request processed in 2077us (3075us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400791.062032:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 118 00000100:00100000:3.0:1786400791.074056:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400791.074346:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850072832 00000100:00100000:2.0:1786400791.074360:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850072832 00000100:00100000:2.0:1786400791.075750:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 119 00000100:00100000:2.0:1786400791.075782:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+8:5566:x1873176850072832:12345-192.168.204.8@tcp:101: 00010000:00010000:2.0:1786400791.075809:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400791.075837:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fca090000/0x5ccaaf4f3cb1d86f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6ba38 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400791.075881:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fca090000/0x5ccaaf4f3cb1d86f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba38 expref: 9 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400791.075895:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fca090000/0x5ccaaf4f3cb1d86f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba38 expref: 9 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400791.075906:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca090000, rc 0) 00000100:00100000:2.0:1786400791.076011:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+9:5566:x1873176850072832:12345-192.168.204.8@tcp:101: Request processed in 245us (1981us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400791.076020:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 119 00000100:00100000:0.0:1786400791.083765:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400791.084498:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850072960 00000100:00100000:2.0:1786400791.084544:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850072960 00000100:00100000:2.0:1786400791.084626:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 120 00000100:00100000:2.0:1786400791.084639:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+9:5566:x1873176850072960:12345-192.168.204.8@tcp:256: 20000000:01000000:2.0:1786400791.084675:0:5781:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1786400791.084698:0:5781:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1786400791.084703:0:5781:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1786400791.084706:0:5781:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1786400791.084709:0:5781:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1786400791.089460:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+9:5566:x1873176850072960:12345-192.168.204.8@tcp:256: Request processed in 4805us (5690us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400791.089482:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 120 00000100:00100000:3.0:1786400791.093322:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400791.093462:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850073088 00000100:00100000:2.0:1786400791.093477:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850073088 00000100:00100000:2.0:1786400791.093623:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 121 00000100:00100000:2.0:1786400791.093637:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+9:5566:x1873176850073088:12345-192.168.204.8@tcp:101: 00010000:00010000:2.0:1786400791.093665:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400791.093693:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fca091c00/0x5ccaaf4f3cb1d876 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6ba3f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400791.093730:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fca091c00/0x5ccaaf4f3cb1d876 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba3f expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400791.093743:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fca091c00/0x5ccaaf4f3cb1d876 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba3f expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400791.093754:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca091c00, rc 0) 00000100:00100000:2.0:1786400791.093846:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:5566:x1873176850073088:12345-192.168.204.8@tcp:101: Request processed in 212us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400791.093853:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 121 00000100:00100000:0.0:1786400791.099604:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400791.099712:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850073216 00000100:00100000:2.0:1786400791.099725:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850073216 00000100:00100000:2.0:1786400791.099804:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 122 00000100:00100000:2.0:1786400791.099816:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:5566:x1873176850073216:12345-192.168.204.8@tcp:501: 00000100:00100000:2.0:1786400791.100254:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:5566:x1873176850073216:12345-192.168.204.8@tcp:501: Request processed in 438us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400791.100264:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 122 00000100:00100000:3.0:1786400791.103002:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400791.103439:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850073344 00000100:00100000:2.0:1786400791.103454:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850073344 00000100:00100000:2.0:1786400791.103699:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 123 00000100:00100000:2.0:1786400791.103713:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:5566:x1873176850073344:12345-192.168.204.8@tcp:503: 00000100:00100000:2.0:1786400791.104421:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:5566:x1873176850073344:12345-192.168.204.8@tcp:503: Request processed in 707us (1430us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400791.104434:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 123 00000100:00100000:3.0:1786400791.108264:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400791.108591:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850073472 00000100:00100000:1.0:1786400791.108604:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850073472 00000100:00100000:1.0:1786400791.108682:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 124 00000100:00100000:1.0:1786400791.108695:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:5590:x1873176850073472:12345-192.168.204.8@tcp:502: 00000100:00100000:0.0:1786400791.110221:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:5590:x1873176850073472:12345-192.168.204.8@tcp:502: Request processed in 1517us (1960us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400791.110236:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 124 00000100:00100000:0.0:1786400791.114174:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400791.114362:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850073600 00000100:00100000:2.0:1786400791.114375:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850073600 00000100:00100000:2.0:1786400791.114507:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 125 00000100:00100000:2.0:1786400791.114520:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:5590:x1873176850073600:12345-192.168.204.8@tcp:502: 00000100:00100000:2.0:1786400791.114868:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:5590:x1873176850073600:12345-192.168.204.8@tcp:502: Request processed in 350us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400791.114878:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 125 00000100:00100000:3.0:1786400791.119863:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400791.120239:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850073728 00000100:00100000:2.0:1786400791.120254:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850073728 00000100:00100000:2.0:1786400791.120333:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4 00000100:00100000:2.0:1786400791.120344:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2361:x1873176850073728:12345-192.168.204.8@tcp:38: 00010000:00080000:2.0:1786400791.120390:0:5789:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 096c63d9-38b8-441b-8c71-343db25fe88a@192.168.204.8@tcp t0 exp 0000000000000000 cur 243 last 0 00000020:00000080:2.0:1786400791.120470:0:5789:0:(genops.c:1406:class_connect()) connect: client 096c63d9-38b8-441b-8c71-343db25fe88a, cookie 0x5ccaaf4f3cb1d87d 00000004:00100000:2.0:1786400791.120629:0:5789:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1786400791.120639:0:5789:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1786400791.163442:0:5789:0:(import.c:65:import_set_state_nolock()) ffff9d6ff5fc8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786400791.163707:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+6:2361:x1873176850073728:12345-192.168.204.8@tcp:38: Request processed in 43360us (43857us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400791.163721:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4 00000100:00100000:0.0:1786400791.278914:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872114816:0@lo:13: 00000100:00100000:0.0:1786400791.279786:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400791.280255:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872114816 00000100:00100000:1.0:1786400791.280268:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872114816 00000100:00100000:1.0:1786400791.280392:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1786400791.280407:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d7000dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872114816:12345-0@lo:13: 00002000:00000024:1.0:1786400791.280460:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400791.280541:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d7000dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872114816:12345-0@lo:13: Request processed in 139us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400791.280549:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1786400791.281142:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1786400791.281246:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff5f9b480 x1873176872114816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400807 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400791.281273:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872114816:0@lo:13: 00010000:00010000:0.0:1786400791.473375:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400791.790795:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5fbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872115328:0@lo:400: 00000100:00100000:3.0:1786400791.790823:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873176872115072:0@lo:400: 00000100:00100000:2.0:1786400791.790898:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400791.790989:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786400791.790996:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5fbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873176872115200:0@lo:400: 00000100:00100000:2.0:1786400791.791024:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400791.791076:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872115200 00000100:00100000:2.0:1786400791.791105:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872115200 00000100:00100000:0.0:1786400791.791121:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:97b0324f-e214-4822-8711-e150ddac2a7e:3306:1873176872114944:0@lo:400: 00000100:00100000:2.0:1786400791.791177:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1786400791.791184:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400791.791199:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5fbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873176872115200:12345-0@lo:400: 00000100:00100000:0.0:1786400791.791218:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5fbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873176872115456:0@lo:400: 00000100:00100000:0.0:1786400791.791246:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400791.791274:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5fbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873176872115200:12345-0@lo:400: Request processed in 82us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400791.791282:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1786400791.791304:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872115456 00000100:00100000:2.0:1786400791.791308:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872115456 00000100:00100000:0.0:1786400791.791317:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872115328 00000100:00100000:0.0:1786400791.791322:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872115328 00000100:00100000:2.0:1786400791.791336:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1786400791.791345:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d7000dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873176872115456:12345-0@lo:400: 00000100:00100000:0.0:1786400791.791363:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786400791.791374:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5fbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872115328:12345-0@lo:400: 00000100:00100000:2.0:1786400791.791384:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d7000dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873176872115456:12345-0@lo:400: Request processed in 40us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400791.791392:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1786400791.791418:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5fbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872115328:12345-0@lo:400: Request processed in 46us (520us total) trans 0 rc 0/0 00000100:00080000:2.0:1786400791.791421:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400791.791426:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1786400791.791465:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff5fbe680 x1873176872115200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400791.791476:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872114944 00000100:00100000:0.0:1786400791.791481:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872114944 00000100:00100000:2.0:1786400791.791484:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5fbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873176872115200:0@lo:400: 00010000:00080000:2.0:1786400791.791499:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff5fbdf80 x1873176872115328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400791.791508:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5fbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872115328:0@lo:400: 00000100:00100000:0.0:1786400791.791527:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1786400791.791534:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786400791.791537:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+19:3306:x1873176872114944:12345-0@lo:400: 00000100:00100000:2.0:1786400791.791544:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872115712:0@lo:13: 00000100:00100000:0.0:1786400791.791580:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+19:3306:x1873176872114944:12345-0@lo:400: Request processed in 45us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400791.791589:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400791.791591:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1786400791.791642:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:97b0324f-e214-4822-8711-e150ddac2a7e:3306:1873176872114944:0@lo:400: 00010000:00080000:0.0:1786400791.791655:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff5fbea00 x1873176872115456/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400791.791678:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5fbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873176872115456:0@lo:400: 00000100:00100000:1.0:1786400791.792944:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872115712 00000100:00100000:1.0:1786400791.792957:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872115712 00000100:00100000:3.0:1786400791.793506:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400791.793652:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1786400791.793665:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872115712:12345-0@lo:13: 00002000:00000024:1.0:1786400791.793710:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400791.794108:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872115072 00000100:00100000:2.0:1786400791.794115:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872115072 00000100:00100000:2.0:1786400791.794154:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1786400791.794163:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873176872115072:12345-0@lo:400: 00000100:00100000:1.0:1786400791.794944:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872115712:12345-0@lo:13: Request processed in 1279us (3352us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400791.795075:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1786400791.795128:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1786400791.795180:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d7000dd5c00 x1873176872115712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400807 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400791.795194:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1786400791.795685:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872115712:0@lo:13: 00000100:00100000:3.0:1786400791.799341:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5fbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872115584:0@lo:400: 00000100:00100000:2.0:1786400791.799378:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873176872115072:12345-0@lo:400: Request processed in 5211us (5868us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400791.799398:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1786400791.799431:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400791.799987:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872115584 00000100:00100000:0.0:1786400791.800001:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872115584 00000100:00100000:0.0:1786400791.800167:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786400791.800182:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872115584:12345-0@lo:400: 00010000:00080000:3.0:1786400791.800204:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fee30c000 x1873176872115072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400791.800257:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872115584:12345-0@lo:400: Request processed in 79us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400791.800282:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1786400791.800339:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873176872115072:0@lo:400: 00010000:00080000:3.0:1786400791.800356:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff5fbed80 x1873176872115584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400791.800365:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5fbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872115584:0@lo:400: 00000100:00100000:3.0:1786400792.166419:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400792.166506:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850073984 00000100:00100000:0.0:1786400792.166576:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850073984 00000100:00100000:0.0:1786400792.166686:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 5 00000100:00100000:0.0:1786400792.166699:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+6:5566:x1873176850073984:12345-192.168.204.8@tcp:41: 00000004:00000024:0.0:1786400792.166760:0:5788:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1786400792.166853:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+6:5566:x1873176850073984:12345-192.168.204.8@tcp:41: Request processed in 156us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400792.166861:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 5 00000100:00080000:1.0:1786400792.167306:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400792.167776:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400792.167951:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850073856 00000100:00100000:1.0:1786400792.167961:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850073856 00000100:00100000:1.0:1786400792.168248:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 6 00000100:00100000:1.0:1786400792.168262:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d7000dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+6:0:x1873176850073856:12345-192.168.204.8@tcp:41: 00000004:00000024:1.0:1786400792.168293:0:5789:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1786400792.168368:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d7000dd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+6:0:x1873176850073856:12345-192.168.204.8@tcp:41: Request processed in 109us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400792.168377:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 6 00000100:00100000:3.0:1786400792.170234:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400792.170707:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850074112 00000100:00100000:0.0:1786400792.170721:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850074112 00000100:00100000:0.0:1786400792.171013:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 7 00000100:00100000:0.0:1786400792.171039:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+6:5566:x1873176850074112:12345-192.168.204.8@tcp:40: 00000100:00100000:0.0:1786400792.171270:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+6:5566:x1873176850074112:12345-192.168.204.8@tcp:40: Request processed in 246us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400792.171280:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 7 00000100:00100000:3.0:1786400792.174853:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400792.175403:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850074240 00000100:00100000:2.0:1786400792.175417:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850074240 00000100:00100000:2.0:1786400792.175479:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 8 00000100:00100000:2.0:1786400792.175490:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2361:x1873176850074240:12345-192.168.204.8@tcp:8: 00010000:00080000:2.0:1786400792.177168:0:6592:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 096c63d9-38b8-441b-8c71-343db25fe88a@192.168.204.8@tcp t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:2.0:1786400792.177223:0:6592:0:(genops.c:1406:class_connect()) connect: client 096c63d9-38b8-441b-8c71-343db25fe88a, cookie 0x5ccaaf4f3cb1d884 00002000:00100000:2.0:1786400792.177242:0:6592:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 096c63d9-38b8-441b-8c71-343db25fe88a/ffff9d6ff5fc8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1786400792.177258:0:6592:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1786400792.177734:0:6592:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1786400792.177781:0:6592:0:(import.c:65:import_set_state_nolock()) ffff9d6ff5fcf800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786400792.177970:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee351880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+6:2361:x1873176850074240:12345-192.168.204.8@tcp:8: Request processed in 2478us (3129us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400792.177983:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 8 00000100:00100000:1.0:1786400792.180452:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400792.180842:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850074496 00000100:00100000:2.0:1786400792.180857:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850074496 00000100:00100000:2.0:1786400792.181459:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 127 00000100:00100000:2.0:1786400792.181475:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:2365:x1873176850074496:12345-192.168.204.8@tcp:400: 00000100:00100000:2.0:1786400792.181561:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:2365:x1873176850074496:12345-192.168.204.8@tcp:400: Request processed in 90us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400792.181570:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 127 00000100:00100000:3.0:1786400792.186670:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400792.186755:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400792.186901:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850074624 00000100:00100000:1.0:1786400792.186989:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850074624 00000100:00100000:1.0:1786400792.187070:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 0 00000100:00100000:1.0:1786400792.187081:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee353100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+6:5566:x1873176850074624:12345-192.168.204.8@tcp:33: 00000100:00100000:0.0:1786400792.187364:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850074368 00000100:00100000:0.0:1786400792.187369:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850074368 00000100:00100000:0.0:1786400792.187404:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 9 00000100:00100000:0.0:1786400792.187410:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2361:x1873176850074368:12345-192.168.204.8@tcp:8: 00010000:00080000:0.0:1786400792.187441:0:6590:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 096c63d9-38b8-441b-8c71-343db25fe88a@192.168.204.8@tcp t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:0.0:1786400792.187480:0:6590:0:(genops.c:1406:class_connect()) connect: client 096c63d9-38b8-441b-8c71-343db25fe88a, cookie 0x5ccaaf4f3cb1d88b 00002000:00100000:0.0:1786400792.187495:0:6590:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 096c63d9-38b8-441b-8c71-343db25fe88a/ffff9d6fc849f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1786400792.187509:0:6590:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1786400792.188295:0:6590:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1786400792.188341:0:6590:0:(import.c:65:import_set_state_nolock()) ffff9d6fc849d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786400792.188728:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+6:2361:x1873176850074368:12345-192.168.204.8@tcp:8: Request processed in 1313us (1969us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400792.188740:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 9 00000004:00080000:1.0:1786400792.226569:0:5791:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 39289us 00000004:00200000:1.0:1786400792.257659:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1786400792.259063:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee353100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+6:5566:x1873176850074624:12345-192.168.204.8@tcp:33: Request processed in 71974us (72400us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400792.259078:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 0 00010000:00010000:2.0:1786400792.494438:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400792.579222:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400792.579350:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850074752 00000100:00100000:2.0:1786400792.579367:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850074752 00000100:00100000:2.0:1786400792.579452:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 8 00000100:00100000:2.0:1786400792.579463:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee351c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+6:5607:x1873176850074752:12345-192.168.204.8@tcp:101: 00010000:00010000:2.0:1786400792.579483:0:6615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400792.579555:0:6615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090c00/0x5ccaaf4f3cb1d892 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6ba69 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400792.579623:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091a00/0x5ccaaf4f3cb1d899 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400792.579648:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091a00/0x5ccaaf4f3cb1d899 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400792.579663:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091a00/0x5ccaaf4f3cb1d899 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400792.579904:0:6615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1786400792.579909:0:6615:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1786400792.579987:0:6615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091a00/0x5ccaaf4f3cb1d899 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400792.580028:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090c00/0x5ccaaf4f3cb1d892 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba69 expref: 8 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400792.580046:0:6615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091a00/0x5ccaaf4f3cb1d899 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba69 expref: 7 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400792.580055:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fd022e000) 00010000:00010000:2.0:1786400792.580059:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786400792.580063:0:6615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca091a00, rc 0) 00000100:00100000:2.0:1786400792.580204:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee351c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+7:5607:x1873176850074752:12345-192.168.204.8@tcp:101: Request processed in 741us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400792.580215:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 8 00010000:00010000:0.0:1786400793.518769:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400794.542334:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400794.749422:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400794.750034:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850074880 00000100:00100000:2.0:1786400794.750050:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850074880 00000100:00100000:2.0:1786400794.750584:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 9 00000100:00100000:2.0:1786400794.750604:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d7000dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+7:5659:x1873176850074880:12345-192.168.204.8@tcp:41: 00000004:00000024:2.0:1786400794.750668:0:5790:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1786400794.750769:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d7000dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+7:5659:x1873176850074880:12345-192.168.204.8@tcp:41: Request processed in 174us (1361us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400794.750777:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 9 00000100:00080000:1.0:1786400794.752501:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400794.755825:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400794.756790:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850075008 00000100:00100000:1.0:1786400794.756806:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850075008 00000100:00100000:1.0:1786400794.757004:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 9 00000100:00100000:1.0:1786400794.757019:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d7000dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:096c63d9-38b8-441b-8c71-343db25fe88a+6:5659:x1873176850075008:12345-192.168.204.8@tcp:13: 00002000:00000024:1.0:1786400794.757077:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400794.757216:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d7000dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:096c63d9-38b8-441b-8c71-343db25fe88a+6:5659:x1873176850075008:12345-192.168.204.8@tcp:13: Request processed in 201us (1405us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400794.757226:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 9 00000100:00080000:2.0:1786400794.760223:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786400794.761567:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400794.762497:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850075136 00000100:00100000:1.0:1786400794.762763:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850075136 00000100:00100000:1.0:1786400794.763057:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 10 00000100:00100000:1.0:1786400794.763073:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:096c63d9-38b8-441b-8c71-343db25fe88a+6:5659:x1873176850075136:12345-192.168.204.8@tcp:13: 00002000:00000024:1.0:1786400794.763160:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1786400794.763291:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786400794.763704:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:096c63d9-38b8-441b-8c71-343db25fe88a+6:5659:x1873176850075136:12345-192.168.204.8@tcp:13: Request processed in 623us (2137us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400794.764186:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 10 00010000:00010000:0.0:1786400795.567366:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1786400795.996198:0:7501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 096c63d9-38b8-441b-8c71-343db25fe88a 00000100:00100000:3.0:1786400796.398547:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786400796.398574:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872115840:0@lo:13: 00000100:00100000:3.0:1786400796.398635:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400796.398741:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872115840 00000100:00100000:0.0:1786400796.398749:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872115840 00000100:00100000:0.0:1786400796.398807:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1786400796.398815:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee351500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872115840:12345-0@lo:13: 00002000:00000024:0.0:1786400796.398845:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786400796.398889:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee351500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872115840:12345-0@lo:13: Request processed in 75us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400796.398896:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1786400796.398932:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d7000dd7480 x1873176872115840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400812 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400796.398961:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872115840:0@lo:13: 00000100:00080000:3.0:1786400796.399021:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1786400796.458300:0:5810:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 096c63d9-38b8-441b-8c71-343db25fe88a 00010000:00010000:2.0:1786400796.590710:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400796.912976:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5fbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:97b0324f-e214-4822-8711-e150ddac2a7e:3306:1873176872115968:0@lo:400: 00000100:00100000:2.0:1786400796.913068:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400796.913137:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5fbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873176872116480:0@lo:400: 00000100:00100000:2.0:1786400796.913164:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400796.913190:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1786400796.913197:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5fbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872116096:0@lo:400: 00000100:00100000:2.0:1786400796.913216:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400796.913233:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5fbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872116608:0@lo:400: 00000100:00100000:2.0:1786400796.913254:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400796.913284:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5fbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873176872116224:0@lo:400: 00000100:00100000:2.0:1786400796.913305:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400796.913322:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786400796.913327:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5fbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872116352:0@lo:400: 00000100:00100000:2.0:1786400796.913347:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400796.913376:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872115968 00000100:00100000:2.0:1786400796.913384:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872115968 00000100:00100000:2.0:1786400796.913432:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1786400796.913441:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+19:3306:x1873176872115968:12345-0@lo:400: 00000100:00100000:2.0:1786400796.913492:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+19:3306:x1873176872115968:12345-0@lo:400: Request processed in 51us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400796.913499:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1786400796.913528:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872116480 00000100:00100000:2.0:1786400796.913531:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872116480 00000100:00100000:2.0:1786400796.913560:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872116096 00000100:00100000:2.0:1786400796.913576:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872116096 00000100:00100000:2.0:1786400796.913590:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872116224 00000100:00100000:2.0:1786400796.913592:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872116224 00000100:00100000:2.0:1786400796.913606:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1786400796.913611:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5fbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873176872116480:12345-0@lo:400: 00000100:00100000:2.0:1786400796.913639:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5fbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873176872116480:12345-0@lo:400: Request processed in 28us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400796.913645:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1786400796.914072:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1786400796.914081:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872116096:12345-0@lo:400: 00000100:00100000:2.0:1786400796.914139:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872116096:12345-0@lo:400: Request processed in 60us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400796.914144:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1786400796.914155:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1786400796.914161:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5fbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873176872116224:12345-0@lo:400: 00000100:00100000:2.0:1786400796.914191:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5fbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873176872116224:12345-0@lo:400: Request processed in 30us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400796.914196:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1786400796.914217:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872116608 00000100:00100000:2.0:1786400796.914221:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872116608 00000100:00100000:2.0:1786400796.914251:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872116352 00000100:00100000:2.0:1786400796.914255:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872116352 00000100:00100000:2.0:1786400796.914269:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1786400796.914274:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5fbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872116608:12345-0@lo:400: 00000100:00100000:2.0:1786400796.914302:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5fbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872116608:12345-0@lo:400: Request processed in 28us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400796.914308:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1786400796.914319:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1786400796.914334:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5fbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872116352:12345-0@lo:400: 00000100:00100000:2.0:1786400796.914363:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5fbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872116352:12345-0@lo:400: Request processed in 31us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400796.914368:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1786400796.914396:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786400796.914401:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1786400796.914436:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff5fbe300 x1873176872116352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400796.914448:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5fbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872116352:0@lo:400: 00000100:00100000:2.0:1786400796.914461:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5fbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873176872116224:0@lo:400: 00000100:00100000:2.0:1786400796.914492:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5fbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872116096:0@lo:400: 00010000:00080000:2.0:1786400796.914502:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff5fbf100 x1873176872116608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400796.914510:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5fbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872116608:0@lo:400: 00000100:00100000:2.0:1786400796.914519:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5fbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:97b0324f-e214-4822-8711-e150ddac2a7e:3306:1873176872115968:0@lo:400: 00000100:00100000:2.0:1786400796.914528:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5fbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873176872116480:0@lo:400: 00000100:00100000:3.0:1786400796.926109:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee353800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872116736:0@lo:13: 00000100:00100000:3.0:1786400796.926199:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400796.932162:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872116736 00000100:00100000:1.0:1786400796.932186:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872116736 00000100:00100000:1.0:1786400796.932243:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1786400796.932255:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872116736:12345-0@lo:13: 00002000:00000024:1.0:1786400796.932299:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400796.932393:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872116736:12345-0@lo:13: Request processed in 141us (6206us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400796.932402:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1786400796.933305:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fee353800 x1873176872116736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400812 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400796.933331:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee353800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872116736:0@lo:13: 00000001:00100000:2.0:1786400797.056333:0:6619:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 096c63d9-38b8-441b-8c71-343db25fe88a 00000100:00100000:0.0:1786400797.244957:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400797.245006:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400797.245032:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400797.245058:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400797.245120:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850075520 00000100:00100000:0.0:1786400797.245131:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850075520 00000100:00100000:0.0:1786400797.245189:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850075648 00000100:00100000:0.0:1786400797.245193:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850075648 00000100:00100000:0.0:1786400797.245209:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 6 00000100:00100000:0.0:1786400797.245219:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d7000dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+5:2363:x1873176850075520:12345-192.168.204.8@tcp:400: 00000100:00100000:0.0:1786400797.245298:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d7000dd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+5:2363:x1873176850075520:12345-192.168.204.8@tcp:400: Request processed in 80us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400797.245305:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 6 00000100:00100000:0.0:1786400797.245323:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 7 00000100:00100000:0.0:1786400797.245329:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d7000dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+5:2363:x1873176850075648:12345-192.168.204.8@tcp:400: 00000100:00100000:0.0:1786400797.245353:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d7000dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+5:2363:x1873176850075648:12345-192.168.204.8@tcp:400: Request processed in 24us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400797.245360:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 7 00000100:00100000:0.0:1786400797.245378:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850075392 00000100:00100000:0.0:1786400797.245381:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850075392 00000100:00100000:0.0:1786400797.245414:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 23 00000100:00100000:0.0:1786400797.245421:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d7000dd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+6:2363:x1873176850075392:12345-192.168.204.8@tcp:400: 00000100:00100000:0.0:1786400797.245447:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d7000dd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+6:2363:x1873176850075392:12345-192.168.204.8@tcp:400: Request processed in 28us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400797.245453:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 23 00000100:00080000:0.0:1786400797.245473:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786400797.245478:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786400797.245479:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786400797.246982:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850075264 00000100:00100000:3.0:1786400797.246993:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850075264 00000100:00100000:3.0:1786400797.247047:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 129 00000100:00100000:3.0:1786400797.247055:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:2363:x1873176850075264:12345-192.168.204.8@tcp:400: 00000100:00100000:3.0:1786400797.247129:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:2363:x1873176850075264:12345-192.168.204.8@tcp:400: Request processed in 75us (2183us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400797.247136:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 129 00010000:00010000:2.0:1786400797.618459:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786400797.639005:0:8158:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1786400798.638904:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400799.668283:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400800.687340:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400801.518340:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786400801.518526:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872116864:0@lo:13: 00000100:00100000:3.0:1786400801.518622:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400801.521242:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872116864 00000100:00100000:1.0:1786400801.521263:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872116864 00000100:00100000:1.0:1786400801.521350:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1786400801.521365:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872116864:12345-0@lo:13: 00002000:00000024:1.0:1786400801.521416:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400801.521521:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872116864:12345-0@lo:13: Request processed in 160us (2899us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400801.521530:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1786400801.521678:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d7000dd6680 x1873176872116864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400817 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400801.521707:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872116864:0@lo:13: 00000100:00080000:1.0:1786400801.522172:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786400801.710943:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1786400801.803724:0:8307:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffc80d025b0 00000020:00000080:1.0:1786400801.803746:0:8307:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1786400801.803881:0:8307:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1786400801.803894:0:8307:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc80d04840 20000000:00000080:1.0:1786400801.803905:0:8307:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d6ffdcd4c00 uarg=0000000000000000 20000000:01000000:1.0:1786400801.803960:0:8307:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1786400801.803963:0:8307:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1786400801.803967:0:8307:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1786400801.803974:0:8307:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1786400801.803980:0:8307:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1786400801.804001:0:8307:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1786400801.804004:0:8307:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1786400801.804431:0:8307:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1786400801.804439:0:8307:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1786400801.806031:0:8308:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1786400801.807502:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1786400801.807566:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1786400801.807627:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1786400801.807644:0:8307:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1786400801.807647:0:8307:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1786400801.808723:0:8309:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1786400801.809541:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1786400801.809615:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1786400801.809658:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1786400801.809673:0:8307:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1786400801.809676:0:8307:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1786400801.810598:0:8310:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1786400801.811710:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1786400801.811873:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1786400801.811911:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1786400801.811928:0:8307:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1786400801.811931:0:8307:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1786400801.813601:0:8311:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1786400801.814626:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1786400801.814706:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1786400801.814745:0:8307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:1.0:1786400801.814858:0:8307:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1786400801.814886:0:8307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d6fc138f200/0x5ccaaf4f3cb1d8a0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.814911:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d79d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d796 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.814920:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fc0030000/0x5ccaaf4f3cb1d7c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d7c0 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.814928:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fc0031000/0x5ccaaf4f3cb1d7f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d7ea expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.814939:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fc0030800/0x5ccaaf4f3cb1d7ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d7f8 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.814959:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fca090e00/0x5ccaaf4f3cb1d80d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d806 expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.814967:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d70020e5200/0x5ccaaf4f3cb1d829 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d822 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.814975:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fc138e400/0x5ccaaf4f3cb1d853 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d84c expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.814988:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fca091600/0x5ccaaf4f3cb1d861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba07 expref: 9 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.814997:0:8307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fca090400/0x5ccaaf4f3cb1d868 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba0e expref: 9 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.815008:0:8307:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d6fc138f200/0x5ccaaf4f3cb1d8a0 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.815065:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fca090400/0x5ccaaf4f3cb1d868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba0e expref: 9 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.815295:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d6fca090400/0x5ccaaf4f3cb1d868 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba0e expref: 9 pid: 5781 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400801.815317:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f9a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1873176872116992:192.168.204.8@tcp:104: 00010000:00010000:1.0:1786400801.815518:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fca091600/0x5ccaaf4f3cb1d861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba07 expref: 9 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.815528:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d6fca091600/0x5ccaaf4f3cb1d861 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba07 expref: 9 pid: 5781 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400801.815546:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f99880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1873176872117120:192.168.204.8@tcp:104: 00010000:00010000:1.0:1786400801.815583:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fc138e400/0x5ccaaf4f3cb1d853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d84c expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.815592:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fc138e400/0x5ccaaf4f3cb1d853 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d84c expref: 18 pid: 5780 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400801.815603:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f9b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1873176872117248:0@lo:104: 00000100:00100000:1.0:1786400801.815673:0:8307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786400801.815723:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d70020e5200/0x5ccaaf4f3cb1d829 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d822 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.815732:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d70020e5200/0x5ccaaf4f3cb1d829 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d822 expref: 18 pid: 5780 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400801.815743:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f99c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1873176872117376:0@lo:104: 00000100:00100000:1.0:1786400801.815781:0:8307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786400801.815817:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fca090e00/0x5ccaaf4f3cb1d80d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d806 expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.815826:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fca090e00/0x5ccaaf4f3cb1d80d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d806 expref: 18 pid: 5781 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400801.815847:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f98a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1873176872117504:0@lo:104: 00010000:00010000:1.0:1786400801.815874:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fc0030800/0x5ccaaf4f3cb1d7ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d7f8 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.815882:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fc0030800/0x5ccaaf4f3cb1d7ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d7f8 expref: 18 pid: 5783 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400801.815897:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f99500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1873176872117632:0@lo:104: 00010000:00010000:1.0:1786400801.815922:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fc0031000/0x5ccaaf4f3cb1d7f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d7ea expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.815930:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fc0031000/0x5ccaaf4f3cb1d7f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d7ea expref: 18 pid: 5780 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400801.815938:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f9b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1873176872117760:0@lo:104: 00010000:00010000:1.0:1786400801.815964:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fc0030000/0x5ccaaf4f3cb1d7c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d7c0 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.815972:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fc0030000/0x5ccaaf4f3cb1d7c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d7c0 expref: 18 pid: 5780 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400801.815980:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f98e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1873176872117888:0@lo:104: 00010000:00010000:1.0:1786400801.816006:0:8307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d79d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d796 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.816015:0:8307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d79d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d796 expref: 18 pid: 5780 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400801.816024:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f98000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1873176872118016:0@lo:104: 00000100:00100000:1.0:1786400801.816043:0:8307:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffd98a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786400801.816316:0:5771:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1786400801.816341:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400801.816355:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400801.816364:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400801.816372:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400801.816379:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400801.816389:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872117248 00000100:00100000:3.0:1786400801.816398:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872117248 00000100:00100000:3.0:1786400801.816449:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872117376 00000100:00100000:3.0:1786400801.816452:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872117376 00000100:00100000:3.0:1786400801.816462:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872117504 00000100:00100000:3.0:1786400801.816464:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872117504 00000100:00100000:3.0:1786400801.816472:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872117632 00000100:00100000:3.0:1786400801.816475:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872117632 00000100:00100000:3.0:1786400801.816482:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872117760 00000100:00100000:3.0:1786400801.816485:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872117760 00000100:00100000:3.0:1786400801.816493:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872117888 00000100:00100000:3.0:1786400801.816495:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872117888 00000100:00100000:3.0:1786400801.816504:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872118016 00000100:00100000:3.0:1786400801.816506:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872118016 00000100:00100000:3.0:1786400801.816520:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1786400801.816529:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:97b0324f-e214-4822-8711-e150ddac2a7e+9:8307:x1873176872117248:12345-0@lo:104: 00010000:00010000:3.0:1786400801.816545:0:5771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.108@tcp lock: ffff9d6fca091200/0x5ccaaf4f3cb1d84c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d853 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400801.816606:0:5771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786400801.816613:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:97b0324f-e214-4822-8711-e150ddac2a7e+9:8307:x1873176872117248:12345-0@lo:104: Request processed in 85us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400801.816620:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1786400801.816640:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1786400801.816646:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdad4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:97b0324f-e214-4822-8711-e150ddac2a7e+8:8307:x1873176872117376:12345-0@lo:104: 00010000:00010000:3.0:1786400801.816665:0:5771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031c00/0x5ccaaf4f3cb1d822 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d829 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400801.816704:0:5771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1786400801.816710:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdad4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:97b0324f-e214-4822-8711-e150ddac2a7e+8:8307:x1873176872117376:12345-0@lo:104: Request processed in 64us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400801.816716:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1786400801.816829:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1786400801.816896:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee352680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:97b0324f-e214-4822-8711-e150ddac2a7e+7:8307:x1873176872117504:12345-0@lo:104: 00010000:00010000:3.0:1786400801.816905:0:5771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.108@tcp lock: ffff9d6fca091400/0x5ccaaf4f3cb1d806 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d80d expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400801.816934:0:5771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1786400801.816939:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee352680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:97b0324f-e214-4822-8711-e150ddac2a7e+7:8307:x1873176872117504:12345-0@lo:104: Request processed in 46us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400801.816945:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1786400801.816958:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1786400801.816964:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee351f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:97b0324f-e214-4822-8711-e150ddac2a7e+6:8307:x1873176872117632:12345-0@lo:104: 00010000:00010000:3.0:1786400801.816971:0:5771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031a00/0x5ccaaf4f3cb1d7f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d7ff expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400801.816997:0:5771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1786400801.817002:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee351f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:97b0324f-e214-4822-8711-e150ddac2a7e+6:8307:x1873176872117632:12345-0@lo:104: Request processed in 39us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400801.817009:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1786400801.817021:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1786400801.817026:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee352a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:97b0324f-e214-4822-8711-e150ddac2a7e+5:8307:x1873176872117760:12345-0@lo:104: 00010000:00010000:3.0:1786400801.817041:0:5771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e800/0x5ccaaf4f3cb1d7ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d7f1 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400801.817067:0:5771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1786400801.817072:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee352a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:97b0324f-e214-4822-8711-e150ddac2a7e+5:8307:x1873176872117760:12345-0@lo:104: Request processed in 47us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400801.817176:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1786400801.817190:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1786400801.817197:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee352d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:97b0324f-e214-4822-8711-e150ddac2a7e+4:8307:x1873176872117888:12345-0@lo:104: 00010000:00010000:3.0:1786400801.817205:0:5771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.108@tcp lock: ffff9d6fca090200/0x5ccaaf4f3cb1d7c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d7c7 expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400801.817233:0:5771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1786400801.817238:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee352d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:97b0324f-e214-4822-8711-e150ddac2a7e+4:8307:x1873176872117888:12345-0@lo:104: Request processed in 43us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400801.817244:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1786400801.817255:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1786400801.817261:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee350380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:97b0324f-e214-4822-8711-e150ddac2a7e+3:8307:x1873176872118016:12345-0@lo:104: 00010000:00010000:3.0:1786400801.817269:0:5771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39200/0x5ccaaf4f3cb1d796 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d79d expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400801.817295:0:5771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1786400801.817300:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee350380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:97b0324f-e214-4822-8711-e150ddac2a7e+3:8307:x1873176872118016:12345-0@lo:104: Request processed in 40us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400801.817306:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1786400801.817443:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1786400801.817451:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fca091200/0x5ccaaf4f3cb1d84c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d853 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.817460:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca091200 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:1.0:1786400801.817471:0:5776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fca091200/0x5ccaaf4f3cb1d84c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5ccaaf4f3cb1d853 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.817483:0:5776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fca091200/0x5ccaaf4f3cb1d84c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5ccaaf4f3cb1d853 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786400801.817491:0:5776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fca091200/0x5ccaaf4f3cb1d84c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5ccaaf4f3cb1d853 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400801.817499:0:5776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786400801.817552:0:5776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6fca091200/0x5ccaaf4f3cb1d84c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d853 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.817560:0:5776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786400801.817590:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fca091200/0x5ccaaf4f3cb1d84c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d853 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.817598:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fca091200/0x5ccaaf4f3cb1d84c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d853 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.817616:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1786400801.817620:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031c00/0x5ccaaf4f3cb1d822 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d829 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.817626:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc0031c00 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:1.0:1786400801.817630:0:5776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031c00/0x5ccaaf4f3cb1d822 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5ccaaf4f3cb1d829 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.817637:0:5776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031c00/0x5ccaaf4f3cb1d822 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5ccaaf4f3cb1d829 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786400801.817655:0:5776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031c00/0x5ccaaf4f3cb1d822 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5ccaaf4f3cb1d829 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400801.817661:0:5776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786400801.817675:0:5776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031c00/0x5ccaaf4f3cb1d822 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d829 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.817682:0:5776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786400801.817687:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031c00/0x5ccaaf4f3cb1d822 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d829 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.817695:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031c00/0x5ccaaf4f3cb1d822 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d829 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.817709:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1786400801.817712:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fca091400/0x5ccaaf4f3cb1d806 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d80d expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.817719:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca091400 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:1.0:1786400801.817722:0:5776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fca091400/0x5ccaaf4f3cb1d806 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5ccaaf4f3cb1d80d expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.817729:0:5776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fca091400/0x5ccaaf4f3cb1d806 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5ccaaf4f3cb1d80d expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786400801.817736:0:5776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fca091400/0x5ccaaf4f3cb1d806 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5ccaaf4f3cb1d80d expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400801.817742:0:5776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1786400801.817881:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:97b0324f-e214-4822-8711-e150ddac2a7e:3307:1873176872118272:0@lo:103: 00000100:00100000:2.0:1786400801.817932:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400801.817979:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786400801.817986:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:97b0324f-e214-4822-8711-e150ddac2a7e:3307:1873176872118144:0@lo:103: 00000100:00100000:2.0:1786400801.818018:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400801.818051:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872118272 00000100:00100000:2.0:1786400801.818061:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872118272 00010000:00010000:2.0:1786400801.818209:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d70020e5200/0x5ccaaf4f3cb1d829 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d822 expref: 19 pid: 5780 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400801.818236:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872118144 00000100:00100000:2.0:1786400801.818240:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872118144 00010000:00010000:2.0:1786400801.818255:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fc138e400/0x5ccaaf4f3cb1d853 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d84c expref: 20 pid: 5780 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400801.818268:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1786400801.818587:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5fbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:97b0324f-e214-4822-8711-e150ddac2a7e+20:3307:x1873176872118272:12345-0@lo:103: 00010000:00010000:2.0:1786400801.818601:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400801.818608:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d70020e5200/0x5ccaaf4f3cb1d829 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d822 expref: 20 pid: 5780 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400801.818619:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d70020e5200/0x5ccaaf4f3cb1d829 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d822 expref: 20 pid: 5780 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400801.818643:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400801.818683:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5fbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:97b0324f-e214-4822-8711-e150ddac2a7e+20:3307:x1873176872118272:12345-0@lo:103: Request processed in 102us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400801.818691:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1786400801.818712:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1786400801.818719:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5fbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:97b0324f-e214-4822-8711-e150ddac2a7e+19:3307:x1873176872118144:12345-0@lo:103: 00010000:00010000:2.0:1786400801.818727:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400801.818732:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fc138e400/0x5ccaaf4f3cb1d853 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d84c expref: 19 pid: 5780 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400801.818843:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fc138e400/0x5ccaaf4f3cb1d853 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d84c expref: 19 pid: 5780 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400801.818854:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400801.818878:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5fbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:97b0324f-e214-4822-8711-e150ddac2a7e+19:3307:x1873176872118144:12345-0@lo:103: Request processed in 160us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400801.818885:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1786400801.818945:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:97b0324f-e214-4822-8711-e150ddac2a7e:3307:1873176872118144:0@lo:103: 00000100:00100000:2.0:1786400801.818956:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:97b0324f-e214-4822-8711-e150ddac2a7e:3307:1873176872118272:0@lo:103: 00010000:00010000:1.0:1786400801.819177:0:5776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6fca091400/0x5ccaaf4f3cb1d806 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d80d expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.819187:0:5776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786400801.819210:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fca091400/0x5ccaaf4f3cb1d806 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d80d expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.819218:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fca091400/0x5ccaaf4f3cb1d806 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d80d expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.819233:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1786400801.819237:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031a00/0x5ccaaf4f3cb1d7f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d7ff expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.819243:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc0031a00 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:1.0:1786400801.819248:0:5776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031a00/0x5ccaaf4f3cb1d7f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5ccaaf4f3cb1d7ff expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.819257:0:5776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031a00/0x5ccaaf4f3cb1d7f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5ccaaf4f3cb1d7ff expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786400801.819264:0:5776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031a00/0x5ccaaf4f3cb1d7f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5ccaaf4f3cb1d7ff expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400801.819269:0:5776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786400801.819283:0:5776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031a00/0x5ccaaf4f3cb1d7f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d7ff expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.819290:0:5776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786400801.819295:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031a00/0x5ccaaf4f3cb1d7f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d7ff expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.819314:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fc0031a00/0x5ccaaf4f3cb1d7f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d7ff expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.819327:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1786400801.819330:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e800/0x5ccaaf4f3cb1d7ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d7f1 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.819336:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138e800 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:1.0:1786400801.819339:0:5776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e800/0x5ccaaf4f3cb1d7ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5ccaaf4f3cb1d7f1 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.819346:0:5776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e800/0x5ccaaf4f3cb1d7ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5ccaaf4f3cb1d7f1 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786400801.819352:0:5776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e800/0x5ccaaf4f3cb1d7ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5ccaaf4f3cb1d7f1 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400801.819358:0:5776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786400801.819372:0:5776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e800/0x5ccaaf4f3cb1d7ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d7f1 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.819379:0:5776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786400801.819387:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e800/0x5ccaaf4f3cb1d7ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d7f1 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.819395:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e800/0x5ccaaf4f3cb1d7ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d7f1 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.819404:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786400801.819413:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fca090200/0x5ccaaf4f3cb1d7c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d7c7 expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.819420:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca090200 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:1.0:1786400801.819423:0:5776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fca090200/0x5ccaaf4f3cb1d7c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5ccaaf4f3cb1d7c7 expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.819430:0:5776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fca090200/0x5ccaaf4f3cb1d7c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5ccaaf4f3cb1d7c7 expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786400801.819438:0:5776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fca090200/0x5ccaaf4f3cb1d7c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5ccaaf4f3cb1d7c7 expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400801.819444:0:5776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786400801.819457:0:5776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6fca090200/0x5ccaaf4f3cb1d7c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d7c7 expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.819463:0:5776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786400801.819468:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fca090200/0x5ccaaf4f3cb1d7c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d7c7 expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.819474:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fca090200/0x5ccaaf4f3cb1d7c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d7c7 expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.819483:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786400801.819487:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39200/0x5ccaaf4f3cb1d796 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d79d expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.819493:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7d39200 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:1.0:1786400801.819496:0:5776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39200/0x5ccaaf4f3cb1d796 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5ccaaf4f3cb1d79d expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.819514:0:5776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39200/0x5ccaaf4f3cb1d796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5ccaaf4f3cb1d79d expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786400801.819521:0:5776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39200/0x5ccaaf4f3cb1d796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5ccaaf4f3cb1d79d expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400801.819527:0:5776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1786400801.819541:0:5776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39200/0x5ccaaf4f3cb1d796 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d79d expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.819547:0:5776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786400801.819551:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39200/0x5ccaaf4f3cb1d796 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d79d expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.819558:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39200/0x5ccaaf4f3cb1d796 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d79d expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400801.819578:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400801.819580:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400801.819583:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400801.819601:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872118400:0@lo:103: 00000100:00100000:1.0:1786400801.819646:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400801.819669:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872118912:0@lo:103: 00000100:00100000:1.0:1786400801.819687:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400801.819703:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786400801.819708:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872118528:0@lo:103: 00000100:00100000:1.0:1786400801.819729:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400801.819898:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:97b0324f-e214-4822-8711-e150ddac2a7e:3306:1873176872118656:0@lo:103: 00000100:00100000:3.0:1786400801.819929:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400801.819963:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786400801.819969:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:97b0324f-e214-4822-8711-e150ddac2a7e:3306:1873176872118784:0@lo:103: 00000100:00100000:3.0:1786400801.819994:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400801.820076:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872118400 00000100:00100000:2.0:1786400801.820115:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872118400 00010000:00010000:2.0:1786400801.820149:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fca090e00/0x5ccaaf4f3cb1d80d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d806 expref: 19 pid: 5781 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400801.820171:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872118912 00000100:00100000:2.0:1786400801.820173:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872118912 00010000:00010000:2.0:1786400801.820184:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d79d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d796 expref: 20 pid: 5780 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400801.820194:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872118528 00000100:00100000:2.0:1786400801.820197:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872118528 00010000:00010000:2.0:1786400801.820206:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fc0030800/0x5ccaaf4f3cb1d7ff lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d7f8 expref: 21 pid: 5783 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400801.820216:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872118656 00000100:00100000:2.0:1786400801.820218:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872118656 00010000:00010000:2.0:1786400801.820228:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fc0031000/0x5ccaaf4f3cb1d7f1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d7ea expref: 22 pid: 5780 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400801.820251:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872118784 00000100:00100000:2.0:1786400801.820254:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872118784 00010000:00010000:2.0:1786400801.820267:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fc0030000/0x5ccaaf4f3cb1d7c7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d7c0 expref: 23 pid: 5780 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400801.820281:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1786400801.820290:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:97b0324f-e214-4822-8711-e150ddac2a7e+23:3308:x1873176872118400:12345-0@lo:103: 00010000:00010000:2.0:1786400801.820303:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400801.820624:0:8307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc138e400/0x5ccaaf4f3cb1d853 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d84c expref: 23 pid: 5780 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400801.820646:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f9b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1873176872117248:0@lo:104: 00010000:00010000:1.0:1786400801.820661:0:8307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d70020e5200/0x5ccaaf4f3cb1d829 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d822 expref: 22 pid: 5780 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400801.820670:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f99c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1873176872117376:0@lo:104: 00000100:00100000:1.0:1786400801.820679:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f98a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1873176872117504:0@lo:104: 00000100:00100000:1.0:1786400801.820686:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f99500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1873176872117632:0@lo:104: 00000100:00100000:1.0:1786400801.820694:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f9b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1873176872117760:0@lo:104: 00000100:00100000:1.0:1786400801.820701:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f98e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1873176872117888:0@lo:104: 00000100:00100000:1.0:1786400801.820710:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f98000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1873176872118016:0@lo:104: 00010000:00010000:2.0:1786400801.820813:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fca090e00/0x5ccaaf4f3cb1d80d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d806 expref: 21 pid: 5781 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400801.820825:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fca090e00/0x5ccaaf4f3cb1d80d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d806 expref: 21 pid: 5781 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400801.820854:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fca090e00/0x5ccaaf4f3cb1d80d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d806 expref: 21 pid: 5781 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400801.820868:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400801.820922:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:97b0324f-e214-4822-8711-e150ddac2a7e+20:3308:x1873176872118400:12345-0@lo:103: Request processed in 632us (1275us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400801.820930:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1786400801.820954:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1786400801.820963:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:97b0324f-e214-4822-8711-e150ddac2a7e+19:3308:x1873176872118912:12345-0@lo:103: 00010000:00010000:2.0:1786400801.820973:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400801.820978:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d79d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d796 expref: 19 pid: 5780 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400801.820987:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d79d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d796 expref: 19 pid: 5780 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400801.821003:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d79d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d796 expref: 19 pid: 5780 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400801.821013:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400801.821033:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:97b0324f-e214-4822-8711-e150ddac2a7e+18:3308:x1873176872118912:12345-0@lo:103: Request processed in 73us (1345us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400801.821039:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1786400801.821051:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1786400801.821057:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:97b0324f-e214-4822-8711-e150ddac2a7e+17:3308:x1873176872118528:12345-0@lo:103: 00010000:00010000:2.0:1786400801.821066:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400801.821070:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fc0030800/0x5ccaaf4f3cb1d7ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d7f8 expref: 17 pid: 5783 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400801.821218:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872118400:0@lo:103: 00000100:00100000:1.0:1786400801.821227:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872118912:0@lo:103: 00010000:00010000:2.0:1786400801.821286:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fc0030800/0x5ccaaf4f3cb1d7ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d7f8 expref: 17 pid: 5783 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400801.821298:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc0030800/0x5ccaaf4f3cb1d7ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d7f8 expref: 17 pid: 5783 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400801.821308:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400801.821339:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:97b0324f-e214-4822-8711-e150ddac2a7e+16:3308:x1873176872118528:12345-0@lo:103: Request processed in 283us (1609us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400801.821345:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1786400801.821358:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1786400801.821364:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee350700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:97b0324f-e214-4822-8711-e150ddac2a7e+15:3306:x1873176872118656:12345-0@lo:103: 00010000:00010000:2.0:1786400801.821372:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400801.821376:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fc0031000/0x5ccaaf4f3cb1d7f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d7ea expref: 15 pid: 5780 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400801.821390:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fc0031000/0x5ccaaf4f3cb1d7f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d7ea expref: 15 pid: 5780 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400801.821401:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc0031000/0x5ccaaf4f3cb1d7f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d7ea expref: 15 pid: 5780 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400801.821415:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400801.821491:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872118528:0@lo:103: 00000100:00100000:2.0:1786400801.821531:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee350700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:97b0324f-e214-4822-8711-e150ddac2a7e+14:3306:x1873176872118656:12345-0@lo:103: Request processed in 168us (1601us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400801.821537:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1786400801.821551:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1786400801.821557:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc458bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:97b0324f-e214-4822-8711-e150ddac2a7e+13:3306:x1873176872118784:12345-0@lo:103: 00010000:00010000:2.0:1786400801.821564:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400801.821568:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fc0030000/0x5ccaaf4f3cb1d7c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d7c0 expref: 13 pid: 5780 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400801.821577:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fc0030000/0x5ccaaf4f3cb1d7c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d7c0 expref: 13 pid: 5780 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400801.821587:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc0030000/0x5ccaaf4f3cb1d7c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d7c0 expref: 13 pid: 5780 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400801.821596:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400801.821618:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc458bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:97b0324f-e214-4822-8711-e150ddac2a7e+12:3306:x1873176872118784:12345-0@lo:103: Request processed in 62us (1623us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400801.821624:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1786400801.821960:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400801.823672:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:97b0324f-e214-4822-8711-e150ddac2a7e:3306:1873176872118656:0@lo:103: 00000100:00100000:3.0:1786400801.823708:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:97b0324f-e214-4822-8711-e150ddac2a7e:3306:1873176872118784:0@lo:103: 00000100:00100000:1.0:1786400801.825383:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f9a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1873176872116992:192.168.204.8@tcp:104: 00000100:00100000:0.0:1786400801.828492:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400801.828546:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400801.828598:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850075776 00000100:00100000:0.0:1786400801.828612:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850075776 00010000:00010000:0.0:1786400801.828667:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fca090400/0x5ccaaf4f3cb1d868 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba0e expref: 10 pid: 5781 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400801.828704:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850075904 00000100:00100000:0.0:1786400801.828707:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850075904 00010000:00010000:0.0:1786400801.828719:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fca091600/0x5ccaaf4f3cb1d861 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba07 expref: 11 pid: 5781 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400801.829003:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 19 00000100:00100000:0.0:1786400801.829016:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d7000dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+11:2365:x1873176850075776:12345-192.168.204.8@tcp:103: 00010000:00010000:0.0:1786400801.829034:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400801.829041:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fca090400/0x5ccaaf4f3cb1d868 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba0e expref: 11 pid: 5781 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400801.829056:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fca090400/0x5ccaaf4f3cb1d868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba0e expref: 11 pid: 5781 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400801.829271:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fca090400/0x5ccaaf4f3cb1d868 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba0e expref: 11 pid: 5781 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400801.829290:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400801.829368:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d7000dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:2365:x1873176850075776:12345-192.168.204.8@tcp:103: Request processed in 354us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400801.829378:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 19 00000100:00100000:0.0:1786400801.829400:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 20 00000100:00100000:0.0:1786400801.829408:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d7000dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+9:2365:x1873176850075904:12345-192.168.204.8@tcp:103: 00010000:00010000:0.0:1786400801.829431:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400801.829435:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fca091600/0x5ccaaf4f3cb1d861 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba07 expref: 9 pid: 5781 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400801.829445:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fca091600/0x5ccaaf4f3cb1d861 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba07 expref: 9 pid: 5781 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400801.829458:0:5773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d6fc138f200/0x5ccaaf4f3cb1d8a0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400801.829467:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc138f200/0x5ccaaf4f3cb1d8a0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400801.829486:0:5773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fc138f200/0x5ccaaf4f3cb1d8a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400801.829495:0:5773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fc138f200/0x5ccaaf4f3cb1d8a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400801.829502:0:5773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d6fc138f200/0x5ccaaf4f3cb1d8a0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400801.829509:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d6fc138f200/0x5ccaaf4f3cb1d8a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400801.829515:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138f200 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:0.0:1786400801.829521:0:5773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d6fc138f200/0x5ccaaf4f3cb1d8a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400801.829530:0:5773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d6fc138f200/0x5ccaaf4f3cb1d8a0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400801.830174:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d6fc138f200/0x5ccaaf4f3cb1d8a0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400801.830196:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400801.830245:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d7000dd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+9:2365:x1873176850075904:12345-192.168.204.8@tcp:103: Request processed in 835us (1696us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400801.830255:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 20 00010000:00010000:2.0:1786400801.830819:0:8307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fca091600/0x5ccaaf4f3cb1d861 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba07 expref: 8 pid: 5781 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400801.831023:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f99880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8307:1873176872117120:192.168.204.8@tcp:104: 00010000:00010000:2.0:1786400801.831307:0:8307:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d6fc138f200/0x5ccaaf4f3cb1d8a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400801.831321:0:8307:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d6fc138f200/0x5ccaaf4f3cb1d8a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400801.831328:0:8307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d6fc138f200/0x5ccaaf4f3cb1d8a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400801.831336:0:8307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc138f200/0x5ccaaf4f3cb1d8a0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400802.034265:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5fbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872119168:0@lo:400: 00000100:00100000:2.0:1786400802.034367:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400802.034434:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5fbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872119680:0@lo:400: 00000100:00100000:2.0:1786400802.034465:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400802.036238:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee353b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872119040:0@lo:13: 00000100:00100000:1.0:1786400802.036334:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400802.036389:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5fbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873176872119552:0@lo:400: 00000100:00100000:1.0:1786400802.036420:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400802.036456:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786400802.036464:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5fbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872119424:0@lo:400: 00000100:00100000:0.0:1786400802.037021:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872119040 00000100:00100000:0.0:1786400802.037034:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872119040 00000100:00080000:1.0:1786400802.037922:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786400802.038294:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1786400802.038311:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872119040:12345-0@lo:13: 00002000:00000024:0.0:1786400802.038366:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786400802.038463:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872119040:12345-0@lo:13: Request processed in 157us (2129us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400802.038472:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1786400802.039007:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786400802.039024:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5fbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872119296:0@lo:400: 00000100:00100000:0.0:1786400802.041005:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872119680 00000100:00100000:0.0:1786400802.041028:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872119680 00000100:00100000:0.0:1786400802.041127:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1786400802.041142:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5fbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872119680:12345-0@lo:400: 00000100:00100000:0.0:1786400802.041254:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5fbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872119680:12345-0@lo:400: Request processed in 115us (6785us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400802.041263:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1786400802.043066:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400802.044261:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872119168 00000100:00100000:0.0:1786400802.044278:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872119168 00000100:00100000:0.0:1786400802.044767:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872119552 00000100:00100000:0.0:1786400802.044773:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872119552 00000100:00100000:0.0:1786400802.044815:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872119296 00000100:00100000:0.0:1786400802.044819:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872119296 00000100:00100000:0.0:1786400802.044877:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1786400802.044887:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5fbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872119168:12345-0@lo:400: 00000100:00080000:1.0:1786400802.044995:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786400802.045031:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1786400802.045045:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873176872119552:12345-0@lo:400: 00000100:00100000:2.0:1786400802.045179:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873176872119552:12345-0@lo:400: Request processed in 138us (8756us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400802.045190:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1786400802.045217:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1786400802.045232:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5fbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872119296:12345-0@lo:400: 00000100:00100000:0.0:1786400802.046269:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5fbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872119168:12345-0@lo:400: Request processed in 1376us (11896us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400802.046413:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1786400802.046749:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5fbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872119296:12345-0@lo:400: Request processed in 1515us (7670us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400802.046759:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1786400802.054982:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1786400802.055141:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fee353b80 x1873176872119040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400802.055174:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee353b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872119040:0@lo:13: 00000100:00100000:2.0:1786400802.055192:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5fbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873176872119552:0@lo:400: 00000100:00100000:2.0:1786400802.055249:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872119424 00000100:00100000:2.0:1786400802.055258:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872119424 00000100:00100000:2.0:1786400802.055329:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1786400802.055340:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5fbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872119424:12345-0@lo:400: 00000100:00100000:2.0:1786400802.055439:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5fbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872119424:12345-0@lo:400: Request processed in 100us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400802.055447:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1786400802.055480:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff5fbf100 x1873176872119424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400802.055491:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5fbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872119424:0@lo:400: 00000100:00100000:2.0:1786400802.055531:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5fbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872119296:0@lo:400: 00000100:00100000:2.0:1786400802.055547:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5fbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872119168:0@lo:400: 00010000:00080000:2.0:1786400802.055560:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff5fbf480 x1873176872119680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400802.055571:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5fbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872119680:0@lo:400: 00000100:00100000:0.0:1786400802.354601:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400802.355661:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400802.355692:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400802.355722:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850076160 00000100:00100000:1.0:1786400802.355735:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850076160 00000100:00100000:0.0:1786400802.355979:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400802.356042:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850076032 00000100:00100000:2.0:1786400802.356048:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850076032 00000100:00100000:2.0:1786400802.356113:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 130 00000100:00100000:2.0:1786400802.356124:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+8:2363:x1873176850076032:12345-192.168.204.8@tcp:400: 00000100:00100000:2.0:1786400802.356216:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+8:2363:x1873176850076032:12345-192.168.204.8@tcp:400: Request processed in 94us (1630us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400802.356225:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 130 00000100:00100000:2.0:1786400802.356292:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 27 00000100:00100000:2.0:1786400802.356301:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d7000dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+6:2363:x1873176850076160:12345-192.168.204.8@tcp:400: 00000100:00100000:2.0:1786400802.356335:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d7000dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+6:2363:x1873176850076160:12345-192.168.204.8@tcp:400: Request processed in 36us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400802.356342:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 27 00000100:00080000:2.0:1786400802.356484:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400802.359929:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850076288 00000100:00100000:3.0:1786400802.359950:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850076288 00000100:00100000:3.0:1786400802.360057:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850076416 00000100:00100000:3.0:1786400802.360061:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850076416 00000100:00100000:3.0:1786400802.360106:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 10 00000100:00100000:3.0:1786400802.360118:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d7000dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+5:2363:x1873176850076288:12345-192.168.204.8@tcp:400: 00000100:00100000:3.0:1786400802.360229:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d7000dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+5:2363:x1873176850076288:12345-192.168.204.8@tcp:400: Request processed in 112us (4535us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400802.360239:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 10 00000100:00080000:1.0:1786400802.360250:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786400802.360258:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786400802.360264:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 11 00000100:00100000:3.0:1786400802.360273:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d7000dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+5:2363:x1873176850076416:12345-192.168.204.8@tcp:400: 00000100:00100000:3.0:1786400802.360303:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d7000dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+5:2363:x1873176850076416:12345-192.168.204.8@tcp:400: Request processed in 31us (4325us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400802.360309:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 11 00010000:00010000:1.0:1786400802.734520:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1786400803.630249:0:5785:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1786400803.630262:0:5785:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d6ec470a000 from 39 10000000:01000000:3.0:1786400803.630269:0:5785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1786400803.630339:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39c00/0x5ccaaf4f3cb1d8a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400803.630354:0:5785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39c00/0x5ccaaf4f3cb1d8a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400803.630393:0:5785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39c00/0x5ccaaf4f3cb1d8a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400803.630424:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee353480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872119808:0@lo:101: 00000100:00100000:3.0:1786400803.630538:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400803.630614:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffa3aee40 going to sleep for 11 seconds 00000100:00100000:0.0:1786400803.631646:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872119808 00000100:00100000:0.0:1786400803.631660:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872119808 00000100:00100000:0.0:1786400803.631802:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1786400803.631816:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+12:5785:x1873176872119808:12345-0@lo:101: 00010000:00010000:0.0:1786400803.631837:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400803.631862:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d70020e4400/0x5ccaaf4f3cb1d8ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d8a7 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400803.631896:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d70020e4400/0x5ccaaf4f3cb1d8ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d8a7 expref: 13 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400803.631908:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d70020e4400/0x5ccaaf4f3cb1d8ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d8a7 expref: 13 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400803.631920:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d70020e4400, rc 0) 00000100:00100000:0.0:1786400803.632005:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+13:5785:x1873176872119808:12345-0@lo:101: Request processed in 191us (1466us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400803.632014:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1786400803.632586:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee353480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872119808:0@lo:101: 00010000:00010000:3.0:1786400803.632610:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39c00/0x5ccaaf4f3cb1d8a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d8ae expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400803.632621:0:5785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39c00/0x5ccaaf4f3cb1d8a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d8ae expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400803.632710:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee353480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872119936:0@lo:501: 00000100:00100000:3.0:1786400803.632751:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400803.633256:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffa3aee40 going to sleep for 11 seconds 00000100:00100000:2.0:1786400803.633672:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872119936 00000100:00100000:2.0:1786400803.633681:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872119936 00000100:00100000:2.0:1786400803.633728:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1786400803.633738:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+13:5785:x1873176872119936:12345-0@lo:501: 00000100:00100000:2.0:1786400803.634958:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+13:5785:x1873176872119936:12345-0@lo:501: Request processed in 1211us (2197us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400803.634973:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1786400803.635167:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee353480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872119936:0@lo:501: 00000100:00100000:3.0:1786400803.635225:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee353480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872120064:0@lo:503: 00000100:00100000:3.0:1786400803.635281:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400803.635324:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffa3aee40 going to sleep for 11 seconds 00000100:00100000:2.0:1786400803.636009:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872120064 00000100:00100000:2.0:1786400803.636020:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872120064 00000100:00100000:2.0:1786400803.636068:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1786400803.636078:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+13:5785:x1873176872120064:12345-0@lo:503: 00000100:00100000:2.0:1786400803.636358:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+13:5785:x1873176872120064:12345-0@lo:503: Request processed in 281us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400803.636377:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1786400803.637026:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee353480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872120064:0@lo:503: 00000100:00100000:3.0:1786400803.638176:0:8323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee353480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:8323:1873176872120192:0@lo:502: 00000100:00100000:3.0:1786400803.638267:0:8323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400803.638324:0:8323:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffa3aee40 going to sleep for 11 seconds 00000100:00100000:2.0:1786400803.638721:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872120192 00000100:00100000:2.0:1786400803.638730:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872120192 00000100:00100000:2.0:1786400803.638783:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1786400803.638804:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+13:8323:x1873176872120192:12345-0@lo:502: 00000100:00100000:2.0:1786400803.639980:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+13:8323:x1873176872120192:12345-0@lo:502: Request processed in 1178us (1703us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400803.639995:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1786400803.640805:0:8323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee353480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:8323:1873176872120192:0@lo:502: 00000100:00100000:3.0:1786400803.640913:0:8323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee353480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:8323:1873176872120320:0@lo:502: 00000100:00100000:3.0:1786400803.640974:0:8323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400803.641023:0:8323:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc3c80cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400803.641645:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872120320 00000100:00100000:2.0:1786400803.641656:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872120320 00000100:00100000:2.0:1786400803.641727:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1786400803.641738:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+13:8323:x1873176872120320:12345-0@lo:502: 00000100:00100000:2.0:1786400803.642068:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+13:8323:x1873176872120320:12345-0@lo:502: Request processed in 331us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400803.642079:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1786400803.642773:0:8323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee353480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:8323:1873176872120320:0@lo:502: 00000040:00080000:3.0:1786400803.642828:0:8323:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1786400803.643832:0:5785:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1786400803.643860:0:5785:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1786400803.643875:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39c00/0x5ccaaf4f3cb1d8a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d8ae expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400803.643904:0:5785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39c00/0x5ccaaf4f3cb1d8a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d8ae expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786400803.643915:0:5785:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1786400803.643918:0:5785:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1786400803.643921:0:5785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1786400803.643971:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5c600/0x5ccaaf4f3cb1d8b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400803.643997:0:5785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5c600/0x5ccaaf4f3cb1d8b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400803.644011:0:5785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5c600/0x5ccaaf4f3cb1d8b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400803.644036:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5fbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872120448:0@lo:101: 00000100:00100000:2.0:1786400803.644135:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400803.644191:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc924f000 going to sleep for 11 seconds 00000100:00100000:0.0:1786400803.644636:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872120448 00000100:00100000:0.0:1786400803.644648:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872120448 00000100:00100000:0.0:1786400803.644722:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1786400803.644733:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+13:5785:x1873176872120448:12345-0@lo:101: 00010000:00010000:0.0:1786400803.644749:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400803.644768:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d70020e5600/0x5ccaaf4f3cb1d8bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d8b5 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400803.644809:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d70020e5600/0x5ccaaf4f3cb1d8bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d8b5 expref: 14 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400803.644823:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d70020e5600/0x5ccaaf4f3cb1d8bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d8b5 expref: 14 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400803.644834:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d70020e5600, rc 0) 00000100:00100000:0.0:1786400803.645650:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+14:5785:x1873176872120448:12345-0@lo:101: Request processed in 913us (1508us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400803.645663:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1786400803.645922:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5fbf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872120448:0@lo:101: 00010000:00010000:3.0:1786400803.645947:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5c600/0x5ccaaf4f3cb1d8b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d8bc expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400803.645960:0:5785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5c600/0x5ccaaf4f3cb1d8b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d8bc expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400803.646046:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee353480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872120576:0@lo:501: 00000100:00100000:3.0:1786400803.646115:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400803.646146:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc3c80cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400803.646366:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872120576 00000100:00100000:0.0:1786400803.646375:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872120576 00000100:00100000:0.0:1786400803.646426:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1786400803.646436:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+14:5785:x1873176872120576:12345-0@lo:501: 00000100:00100000:0.0:1786400803.650480:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+14:5785:x1873176872120576:12345-0@lo:501: Request processed in 4032us (4351us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400803.650498:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1786400803.650673:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee353480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872120576:0@lo:501: 00000100:00100000:3.0:1786400803.650742:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee353480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872120704:0@lo:503: 00000100:00100000:3.0:1786400803.650817:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400803.650962:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc3c80cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400803.651018:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872120704 00000100:00100000:2.0:1786400803.651026:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872120704 00000100:00100000:2.0:1786400803.651113:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1786400803.651124:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+14:5785:x1873176872120704:12345-0@lo:503: 00000100:00100000:2.0:1786400803.651339:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+14:5785:x1873176872120704:12345-0@lo:503: Request processed in 216us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400803.651347:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1786400803.651441:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee353480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872120704:0@lo:503: 00000100:00100000:3.0:1786400803.652210:0:8324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee353480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:8324:1873176872120832:0@lo:502: 00000100:00100000:3.0:1786400803.652260:0:8324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400803.652330:0:8324:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc3c806c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400803.652574:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872120832 00000100:00100000:2.0:1786400803.652581:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872120832 00000100:00100000:2.0:1786400803.652668:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1786400803.652680:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+14:8324:x1873176872120832:12345-0@lo:502: 00000100:00100000:2.0:1786400803.653701:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+14:8324:x1873176872120832:12345-0@lo:502: Request processed in 1015us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400803.653713:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1786400803.653872:0:8324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee353480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:8324:1873176872120832:0@lo:502: 00000020:01000000:3.0:1786400803.653936:0:8324:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786400803.653949:0:8324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786400803.653952:0:8324:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1786400803.653958:0:8324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1786400803.653996:0:8324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee353480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:8324:1873176872120960:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786400803.654042:0:8324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400803.657322:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872120960 00000100:00100000:1.0:1786400803.657344:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872120960 00000100:00100000:1.0:1786400803.657409:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1786400803.657420:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+14:8324:x1873176872120960:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786400803.657666:0:8324:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffa3aee40 going to sleep for 11 seconds 00000100:00100000:1.0:1786400803.657987:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+14:8324:x1873176872120960:12345-0@lo:502:llog_process_th.0 Request processed in 567us (3944us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400803.657996:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1786400803.658140:0:8324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee353480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:8324:1873176872120960:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1786400803.658182:0:8324:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786400803.658198:0:8324:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786400803.658201:0:8324:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1786400803.658208:0:8324:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1786400803.658407:0:5785:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1786400803.658427:0:5785:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1786400803.658441:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5c600/0x5ccaaf4f3cb1d8b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d8bc expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400803.658455:0:5785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5c600/0x5ccaaf4f3cb1d8b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d8bc expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400803.658467:0:5785:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1786400803.658470:0:5785:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d6fc49f0000 from 39 10000000:01000000:1.0:1786400803.658473:0:5785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1786400803.658512:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e200/0x5ccaaf4f3cb1d8c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400803.658531:0:5785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e200/0x5ccaaf4f3cb1d8c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400803.658542:0:5785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e200/0x5ccaaf4f3cb1d8c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400803.658576:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f9aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872121088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786400803.658619:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400803.658652:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffd98a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400803.658760:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872121088 00000100:00100000:2.0:1786400803.658767:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872121088 00000100:00100000:2.0:1786400803.658829:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1786400803.658839:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+14:5785:x1873176872121088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786400803.658852:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400803.658868:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fc4e5ca00/0x5ccaaf4f3cb1d8ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d8c3 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400803.658898:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc4e5ca00/0x5ccaaf4f3cb1d8ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d8c3 expref: 15 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400803.658910:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fc4e5ca00/0x5ccaaf4f3cb1d8ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d8c3 expref: 15 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400803.658920:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc4e5ca00, rc 0) 00000100:00100000:2.0:1786400803.658956:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+15:5785:x1873176872121088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400803.658963:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1786400803.659137:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f9aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872121088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786400803.659152:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e200/0x5ccaaf4f3cb1d8c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d8ca expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400803.659161:0:5785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e200/0x5ccaaf4f3cb1d8c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d8ca expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400803.659217:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f9aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872121216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786400803.659245:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400803.659265:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffd98a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400803.659762:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872121216 00000100:00100000:2.0:1786400803.659769:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872121216 00000100:00100000:2.0:1786400803.659810:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1786400803.659820:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+15:5785:x1873176872121216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786400803.660333:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+15:5785:x1873176872121216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 512us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400803.660343:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1786400803.661046:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f9aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872121216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786400803.661135:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee352300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872121344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786400803.661198:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400803.661239:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc3c806c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400803.661442:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872121344 00000100:00100000:2.0:1786400803.661456:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872121344 00000100:00100000:2.0:1786400803.661490:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1786400803.661502:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+15:5785:x1873176872121344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786400803.662722:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+15:5785:x1873176872121344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1214us (1515us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400803.662738:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1786400803.663850:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee352300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872121344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786400803.665479:0:8325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f9aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:8325:1873176872121472:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786400803.665756:0:8325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400803.666015:0:8325:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffd98ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1786400803.666667:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872121472 00000100:00100000:2.0:1786400803.666681:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872121472 00000100:00100000:2.0:1786400803.666804:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1786400803.666816:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+15:8325:x1873176872121472:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786400803.667220:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+15:8325:x1873176872121472:12345-0@lo:502:llog_process_th.0 Request processed in 406us (1464us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400803.667230:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1786400803.668080:0:8325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f9aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:8325:1873176872121472:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786400803.668191:0:8325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f9aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:8325:1873176872121600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786400803.668255:0:8325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400803.669854:0:8325:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffd98ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1786400803.669951:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872121600 00000100:00100000:2.0:1786400803.669962:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872121600 00000100:00100000:0.0:1786400803.670061:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1786400803.670079:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+15:8325:x1873176872121600:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786400803.670467:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+15:8325:x1873176872121600:12345-0@lo:502:llog_process_th.0 Request processed in 392us (2210us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400803.670476:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1786400803.671829:0:8325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f9aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:8325:1873176872121600:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1786400803.671894:0:8325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1786400803.672217:0:5785:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1786400803.672246:0:5785:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1786400803.672260:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e200/0x5ccaaf4f3cb1d8c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d8ca expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400803.672273:0:5785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e200/0x5ccaaf4f3cb1d8c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d8ca expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786400803.672284:0:5785:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1786400803.672288:0:5785:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1786400803.672291:0:5785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1786400803.672353:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d70020e4200/0x5ccaaf4f3cb1d8d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400803.672364:0:5785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d70020e4200/0x5ccaaf4f3cb1d8d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400803.672378:0:5785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d70020e4200/0x5ccaaf4f3cb1d8d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400803.672408:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872121728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786400803.672481:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400803.673053:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffd5b1900 going to sleep for 11 seconds 00000100:00100000:0.0:1786400803.673108:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872121728 00000100:00100000:0.0:1786400803.673117:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872121728 00000100:00100000:0.0:1786400803.673169:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1786400803.673179:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+15:5785:x1873176872121728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786400803.673196:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400803.673217:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d70020e5800/0x5ccaaf4f3cb1d8d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d8d1 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400803.673269:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d70020e5800/0x5ccaaf4f3cb1d8d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d8d1 expref: 16 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400803.673280:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d70020e5800/0x5ccaaf4f3cb1d8d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d8d1 expref: 16 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400803.673289:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d70020e5800, rc 0) 00000100:00100000:0.0:1786400803.673346:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+16:5785:x1873176872121728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400803.673354:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1786400803.673408:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872121728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786400803.673426:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d70020e4200/0x5ccaaf4f3cb1d8d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d8d8 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400803.673437:0:5785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d70020e4200/0x5ccaaf4f3cb1d8d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d8d8 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400803.673502:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872121856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786400803.674664:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400803.674709:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffd5b1900 going to sleep for 11 seconds 00000100:00100000:3.0:1786400803.674966:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872121856 00000100:00100000:3.0:1786400803.674977:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872121856 00000100:00100000:3.0:1786400803.675049:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1786400803.675060:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+16:5785:x1873176872121856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786400803.675460:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+16:5785:x1873176872121856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 401us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400803.675468:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1786400803.678145:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872121856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786400803.678227:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872121984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786400803.678331:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400803.678378:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffd5b1900 going to sleep for 11 seconds 00000100:00100000:3.0:1786400803.678968:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872121984 00000100:00100000:3.0:1786400803.678979:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872121984 00000100:00100000:3.0:1786400803.679040:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1786400803.679051:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+16:5785:x1873176872121984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786400803.679317:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+16:5785:x1873176872121984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 266us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400803.679325:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1786400803.680043:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872121984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786400803.681360:0:8326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:8326:1873176872122112:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786400803.681462:0:8326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400803.683383:0:8326:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffd5b1000 going to sleep for 11 seconds 00000100:00100000:3.0:1786400803.684487:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872122112 00000100:00100000:3.0:1786400803.684502:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872122112 00000100:00100000:3.0:1786400803.684941:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1786400803.684955:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+16:8326:x1873176872122112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786400803.685323:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+16:8326:x1873176872122112:12345-0@lo:502:llog_process_th.0 Request processed in 370us (3860us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400803.685333:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1786400803.686206:0:8326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:8326:1873176872122112:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1786400803.686254:0:8326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786400803.686269:0:8326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786400803.686272:0:8326:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1786400803.686280:0:8326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1786400803.686328:0:8326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:8326:1873176872122240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786400803.686405:0:8326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400803.687686:0:8326:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffd5b1000 going to sleep for 11 seconds 00000100:00100000:2.0:1786400803.687924:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872122240 00000100:00100000:2.0:1786400803.687935:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872122240 00000100:00100000:2.0:1786400803.688001:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1786400803.688012:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+16:8326:x1873176872122240:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786400803.688359:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+16:8326:x1873176872122240:12345-0@lo:502:llog_process_th.0 Request processed in 348us (1953us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400803.688367:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1786400803.689043:0:8326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:8326:1873176872122240:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1786400803.689122:0:8326:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786400803.689133:0:8326:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786400803.689136:0:8326:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1786400803.689141:0:8326:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1786400803.690277:0:5785:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1786400803.690314:0:5785:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1786400803.690329:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d70020e4200/0x5ccaaf4f3cb1d8d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d8d8 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400803.690365:0:5785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d70020e4200/0x5ccaaf4f3cb1d8d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d8d8 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786400803.690379:0:5785:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1786400803.690382:0:5785:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d6fc307d800 from 39 10000000:01000000:2.0:1786400803.690385:0:5785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1786400803.690436:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5d200/0x5ccaaf4f3cb1d8df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400803.690444:0:5785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5d200/0x5ccaaf4f3cb1d8df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400803.690456:0:5785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5d200/0x5ccaaf4f3cb1d8df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400803.690485:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5fbd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872122368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786400803.690673:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400803.691741:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc924f000 going to sleep for 11 seconds 00000100:00100000:3.0:1786400803.691833:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872122368 00000100:00100000:3.0:1786400803.691846:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872122368 00000100:00100000:0.0:1786400803.691926:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1786400803.691942:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+16:5785:x1873176872122368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786400803.691964:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400803.691986:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d70020e5200/0x5ccaaf4f3cb1d8e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d8df expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400803.692020:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d70020e5200/0x5ccaaf4f3cb1d8e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d8df expref: 17 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400803.692032:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d70020e5200/0x5ccaaf4f3cb1d8e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d8df expref: 17 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400803.692062:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d70020e5200, rc 0) 00000100:00100000:0.0:1786400803.692183:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+17:5785:x1873176872122368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 244us (1510us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400803.692191:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1786400803.692258:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5fbd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872122368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786400803.692277:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5d200/0x5ccaaf4f3cb1d8df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d8e6 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400803.692288:0:5785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5d200/0x5ccaaf4f3cb1d8df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d8e6 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400803.692369:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872122496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786400803.692403:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400803.692423:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffd5b1180 going to sleep for 11 seconds 00000100:00100000:0.0:1786400803.692435:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872122496 00000100:00100000:0.0:1786400803.692438:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872122496 00000100:00100000:0.0:1786400803.692456:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1786400803.692462:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+17:5785:x1873176872122496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786400803.692790:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+17:5785:x1873176872122496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 326us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400803.695121:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1786400803.695221:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872122496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786400803.695295:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872122624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786400803.695393:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400803.695435:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffd5b1180 going to sleep for 11 seconds 00000100:00100000:0.0:1786400803.695462:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872122624 00000100:00100000:0.0:1786400803.695469:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872122624 00000100:00100000:0.0:1786400803.695508:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1786400803.695585:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+17:5785:x1873176872122624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786400803.695842:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+17:5785:x1873176872122624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 260us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400803.695850:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1786400803.695891:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872122624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786400803.696500:0:8327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f9aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:8327:1873176872122752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786400803.696762:0:8327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400803.696791:0:8327:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffd98ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1786400803.697175:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872122752 00000100:00100000:0.0:1786400803.697183:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872122752 00000100:00100000:0.0:1786400803.697229:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1786400803.697239:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+17:8327:x1873176872122752:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786400803.698278:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+17:8327:x1873176872122752:12345-0@lo:502:llog_process_th.0 Request processed in 1034us (1509us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400803.698291:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1786400803.698941:0:8327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f9aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:8327:1873176872122752:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786400803.699038:0:8327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5fbe680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:8327:1873176872122880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786400803.705880:0:8327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400803.706338:0:8327:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc924f780 going to sleep for 11 seconds 00000100:00100000:3.0:1786400803.706956:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872122880 00000100:00100000:3.0:1786400803.706970:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872122880 00000100:00100000:3.0:1786400803.707121:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1786400803.707134:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+17:8327:x1873176872122880:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786400803.707508:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+17:8327:x1873176872122880:12345-0@lo:502:llog_process_th.0 Request processed in 376us (1639us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400803.708782:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1786400803.708987:0:8327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5fbe680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:8327:1873176872122880:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1786400803.709036:0:8327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1786400803.709642:0:5785:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1786400803.709674:0:5785:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1786400803.709687:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5d200/0x5ccaaf4f3cb1d8df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d8e6 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400803.709700:0:5785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5d200/0x5ccaaf4f3cb1d8df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d8e6 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786400803.709712:0:5785:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1786400803.709716:0:5785:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1786400803.709719:0:5785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1786400803.709791:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab000/0x5ccaaf4f3cb1d8ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400803.709819:0:5785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab000/0x5ccaaf4f3cb1d8ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400803.709831:0:5785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab000/0x5ccaaf4f3cb1d8ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400803.709861:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872123008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786400803.709939:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400803.711351:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffd5b1840 going to sleep for 11 seconds 00000100:00100000:1.0:1786400803.711446:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872123008 00000100:00100000:1.0:1786400803.711458:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872123008 00000100:00100000:2.0:1786400803.711557:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1786400803.711579:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+17:5785:x1873176872123008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786400803.711626:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400803.711652:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fc4e5c400/0x5ccaaf4f3cb1d8f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d8ed expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400803.711692:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc4e5c400/0x5ccaaf4f3cb1d8f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d8ed expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400803.711705:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fc4e5c400/0x5ccaaf4f3cb1d8f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d8ed expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400803.711716:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc4e5c400, rc 0) 00000100:00100000:2.0:1786400803.711807:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+18:5785:x1873176872123008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 227us (1856us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400803.711815:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1786400803.712543:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872123008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786400803.712568:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab000/0x5ccaaf4f3cb1d8ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d8f4 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400803.712581:0:5785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab000/0x5ccaaf4f3cb1d8ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d8f4 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400803.712676:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872123136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786400803.712720:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400803.712758:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872123136 00000100:00100000:0.0:1786400803.712764:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872123136 00000100:00100000:0.0:1786400803.712805:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1786400803.712814:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+18:5785:x1873176872123136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786400803.713180:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+18:5785:x1873176872123136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 365us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400803.713189:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1786400803.713229:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffd5b1840 going to sleep for 11 seconds 00000100:00100000:0.0:1786400803.713250:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872123136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786400803.713280:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872123264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786400803.713319:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400803.713340:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872123264 00000100:00100000:0.0:1786400803.713344:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872123264 00000100:00100000:0.0:1786400803.713361:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1786400803.713366:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+18:5785:x1873176872123264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786400803.713524:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+18:5785:x1873176872123264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400803.713531:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1786400803.713559:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffd5b1840 going to sleep for 11 seconds 00000100:00100000:0.0:1786400803.713571:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872123264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786400803.713787:0:8328:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:8328:1873176872123392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786400803.713836:0:8328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400803.713854:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872123392 00000100:00100000:0.0:1786400803.713858:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872123392 00000100:00100000:0.0:1786400803.713875:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1786400803.713880:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+18:8328:x1873176872123392:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786400803.714049:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+18:8328:x1873176872123392:12345-0@lo:502:llog_process_th.0 Request processed in 168us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400803.714056:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1786400803.714083:0:8328:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffd5b1780 going to sleep for 11 seconds 00000100:00100000:0.0:1786400803.714119:0:8328:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:8328:1873176872123392:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1786400803.714143:0:8328:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786400803.714160:0:8328:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786400803.714163:0:8328:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1786400803.714171:0:8328:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1786400803.714192:0:8328:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:8328:1873176872123520:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786400803.714224:0:8328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400803.714243:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872123520 00000100:00100000:0.0:1786400803.714247:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872123520 00000100:00100000:0.0:1786400803.714264:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1786400803.714270:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+18:8328:x1873176872123520:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786400803.714379:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+18:8328:x1873176872123520:12345-0@lo:502:llog_process_th.0 Request processed in 108us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400803.714386:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1786400803.714417:0:8328:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffd5b1780 going to sleep for 11 seconds 00000100:00100000:0.0:1786400803.714429:0:8328:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:8328:1873176872123520:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1786400803.714445:0:8328:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786400803.714450:0:8328:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786400803.714451:0:8328:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1786400803.714455:0:8328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1786400803.714512:0:5785:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1786400803.714531:0:5785:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1786400803.714541:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab000/0x5ccaaf4f3cb1d8ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d8f4 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400803.714552:0:5785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab000/0x5ccaaf4f3cb1d8ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d8f4 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786400803.714564:0:5785:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1786400803.714566:0:5785:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9d6fc523cd40 from 1 10000000:01000000:0.0:1786400803.714570:0:5785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1786400803.714602:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1d8fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400803.714610:0:5785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1d8fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400803.714620:0:5785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1d8fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400803.714634:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872123648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786400803.714660:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400803.714673:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffd5b1780 going to sleep for 11 seconds 00000100:00100000:0.0:1786400803.714685:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872123648 00000100:00100000:0.0:1786400803.714688:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872123648 00000100:00100000:0.0:1786400803.714706:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1786400803.714712:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+18:5785:x1873176872123648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786400803.714721:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400803.714736:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ffd5aa000/0x5ccaaf4f3cb1d902 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d8fb expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400803.714759:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ffd5aa000/0x5ccaaf4f3cb1d902 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d8fb expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400803.714770:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ffd5aa000/0x5ccaaf4f3cb1d902 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d8fb expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400803.714779:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5aa000, rc 0) 00000100:00100000:0.0:1786400803.717854:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+19:5785:x1873176872123648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3127us (3177us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400803.717870:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1786400803.718066:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872123648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786400803.718120:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1d8fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d902 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400803.718137:0:5785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1d8fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d902 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400803.718246:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5fbe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872123776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786400803.718312:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400803.719561:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc924fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1786400803.719955:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872123776 00000100:00100000:0.0:1786400803.719967:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872123776 00000100:00100000:0.0:1786400803.720012:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1786400803.720023:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+19:5785:x1873176872123776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786400803.720391:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+19:5785:x1873176872123776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 369us (2077us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786400803.720399:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1786400803.721443:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5fbe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872123776:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1786400803.721505:0:5785:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1786400803.721844:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1d8fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d902 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400803.721875:0:5785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1d8fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d902 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400803.758642:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400804.782947:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400804.787220:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400804.788326:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850076544 00000100:00100000:0.0:1786400804.788346:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850076544 00000100:00100000:0.0:1786400804.788436:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 163 00000100:00100000:0.0:1786400804.788449:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+8:5580:x1873176850076544:12345-192.168.204.8@tcp:101: 00010000:00010000:0.0:1786400804.788473:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400804.789140:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ffd5abc00/0x5ccaaf4f3cb1d909 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6ba70 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400804.789187:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ffd5abc00/0x5ccaaf4f3cb1d909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba70 expref: 9 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400804.789200:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ffd5abc00/0x5ccaaf4f3cb1d909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba70 expref: 9 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400804.789212:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5abc00, rc 0) 00000100:00100000:0.0:1786400804.789701:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+9:5580:x1873176850076544:12345-192.168.204.8@tcp:101: Request processed in 1251us (2493us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400804.789711:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 163 00000100:00100000:1.0:1786400804.794302:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400804.795239:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850076672 00000100:00100000:0.0:1786400804.795256:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850076672 00000100:00100000:0.0:1786400804.795353:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 164 00000100:00100000:0.0:1786400804.795365:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+9:5580:x1873176850076672:12345-192.168.204.8@tcp:501: 00000100:00100000:0.0:1786400804.795822:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+9:5580:x1873176850076672:12345-192.168.204.8@tcp:501: Request processed in 458us (1535us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400804.795831:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 164 00000100:00100000:2.0:1786400804.799288:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400804.799832:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850076800 00000100:00100000:0.0:1786400804.799846:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850076800 00000100:00100000:0.0:1786400804.800172:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 165 00000100:00100000:0.0:1786400804.800190:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+9:5580:x1873176850076800:12345-192.168.204.8@tcp:503: 00000100:00100000:0.0:1786400804.800645:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+9:5580:x1873176850076800:12345-192.168.204.8@tcp:503: Request processed in 460us (1370us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400804.800656:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 165 00000100:00100000:2.0:1786400804.808659:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400804.810147:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850076928 00000100:00100000:0.0:1786400804.810169:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850076928 00000100:00100000:0.0:1786400804.810259:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 166 00000100:00100000:0.0:1786400804.810272:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+9:6060:x1873176850076928:12345-192.168.204.8@tcp:502: 00000100:00100000:0.0:1786400804.812569:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+9:6060:x1873176850076928:12345-192.168.204.8@tcp:502: Request processed in 2284us (3911us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400804.812588:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 166 00000100:00100000:3.0:1786400804.819750:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400804.820077:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850077056 00000100:00100000:0.0:1786400804.820122:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850077056 00000100:00100000:0.0:1786400804.820211:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 167 00000100:00100000:0.0:1786400804.820224:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+9:6060:x1873176850077056:12345-192.168.204.8@tcp:502:llog_process_th.0 00000100:00100000:0.0:1786400804.820627:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+9:6060:x1873176850077056:12345-192.168.204.8@tcp:502:llog_process_th.0 Request processed in 404us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400804.820648:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 167 00000100:00100000:2.0:1786400804.830603:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400804.830904:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850077184 00000100:00100000:0.0:1786400804.830918:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850077184 00000100:00100000:0.0:1786400804.830995:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 168 00000100:00100000:0.0:1786400804.831005:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+9:5580:x1873176850077184:12345-192.168.204.8@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786400804.831028:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400804.831049:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ffd5abe00/0x5ccaaf4f3cb1d910 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6ba77 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400804.831120:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ffd5abe00/0x5ccaaf4f3cb1d910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba77 expref: 10 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400804.831134:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ffd5abe00/0x5ccaaf4f3cb1d910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba77 expref: 10 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400804.831145:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5abe00, rc 0) 00000100:00100000:0.0:1786400804.831224:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:5580:x1873176850077184:12345-192.168.204.8@tcp:101:ll_cfg_requeue.0 Request processed in 220us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400804.831233:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 168 00000100:00100000:2.0:1786400804.841502:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400804.841660:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850077312 00000100:00100000:0.0:1786400804.841682:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850077312 00000100:00100000:0.0:1786400804.842243:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 169 00000100:00100000:0.0:1786400804.842259:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:5580:x1873176850077312:12345-192.168.204.8@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786400804.842644:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:5580:x1873176850077312:12345-192.168.204.8@tcp:501:ll_cfg_requeue.0 Request processed in 388us (1156us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786400804.842655:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 169 00010000:00010000:0.0:1786400805.806250:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1786400806.131680:0:8365:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffe1d431110 00000020:00000080:0.0:1786400806.131694:0:8365:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:0.0:1786400806.131698:0:8365:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:0.0:1786400806.131705:0:8365:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe1d4333a0 20000000:00000080:0.0:1786400806.131711:0:8365:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d6ff5f5c000 uarg=0000000000000000 20000000:01000000:0.0:1786400806.132273:0:8365:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1786400806.132279:0:8365:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1786400806.132284:0:8365:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1786400806.134298:0:8367:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1786400806.134460:0:8365:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1786400806.142975:0:8365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1786400806.143036:0:8365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1786400806.143260:0:8365:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1786400806.143279:0:8365:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1786400806.143299:0:8365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1d917 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400806.143317:0:8365:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fc138f400/0x5ccaaf4f3cb1d68c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d685 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400806.143323:0:8365:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fca091800/0x5ccaaf4f3cb1d6ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d6e7 expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400806.143342:0:8365:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1d7b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d7b2 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400806.143351:0:8365:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fca091c00/0x5ccaaf4f3cb1d876 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba3f expref: 9 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400806.143360:0:8365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1d917 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400806.143398:0:8365:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fca091c00/0x5ccaaf4f3cb1d876 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba3f expref: 9 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400806.143412:0:8365:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d6fca091c00/0x5ccaaf4f3cb1d876 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba3f expref: 9 pid: 5783 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400806.143426:0:8365:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee352300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8365:1873176872123904:192.168.204.8@tcp:104: 00010000:00010000:3.0:1786400806.143702:0:8365:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1d7b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d7b2 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400806.143711:0:8365:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1d7b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d7b2 expref: 18 pid: 5783 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400806.143720:0:8365:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee353480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8365:1873176872124032:0@lo:104: 00000100:00100000:3.0:1786400806.143765:0:8365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1786400806.143801:0:8365:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fca091800/0x5ccaaf4f3cb1d6ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d6e7 expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400806.143809:0:8365:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fca091800/0x5ccaaf4f3cb1d6ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d6e7 expref: 18 pid: 5781 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400806.143828:0:8365:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee350700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8365:1873176872124160:0@lo:104: 00000100:00100000:3.0:1786400806.143850:0:8365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400806.143876:0:5771:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1786400806.143891:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872124032 00000100:00100000:0.0:1786400806.143898:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872124032 00000100:00100000:0.0:1786400806.143938:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872124160 00010000:00010000:3.0:1786400806.143940:0:8365:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fc138f400/0x5ccaaf4f3cb1d68c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d685 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400806.143942:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872124160 00010000:00010000:3.0:1786400806.143953:0:8365:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fc138f400/0x5ccaaf4f3cb1d68c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d685 expref: 18 pid: 5780 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400806.143962:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1786400806.143964:0:8365:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee353800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8365:1873176872124288:0@lo:104: 00000100:00100000:0.0:1786400806.143974:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee353b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:97b0324f-e214-4822-8711-e150ddac2a7e+4:8365:x1873176872124032:12345-0@lo:104: 00000100:00100000:3.0:1786400806.143989:0:8365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1786400806.143990:0:5771:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.108@tcp lock: ffff9d6fc0030a00/0x5ccaaf4f3cb1d7b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d7b9 expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400806.144000:0:8365:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd0beba80 going to sleep for 11 seconds 00000100:00100000:2.0:1786400806.145022:0:5772:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1786400806.145031:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:0.0:1786400806.145300:0:5771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786400806.145310:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee353b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:97b0324f-e214-4822-8711-e150ddac2a7e+4:8365:x1873176872124032:12345-0@lo:104: Request processed in 1337us (1542us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400806.145319:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1786400806.145344:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872124288 00000100:00100000:0.0:1786400806.145350:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872124288 00000100:00100000:2.0:1786400806.146319:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1786400806.146335:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdad5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:97b0324f-e214-4822-8711-e150ddac2a7e+4:8365:x1873176872124160:12345-0@lo:104: 00010000:00010000:0.0:1786400806.146337:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786400806.146347:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fc0030a00/0x5ccaaf4f3cb1d7b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d7b9 expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400806.146354:0:5772:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.108@tcp lock: ffff9d6fca091000/0x5ccaaf4f3cb1d6e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d6ee expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400806.146359:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc0030a00 already unused, calling callback (ffffffffc1d6dc20) 00010000:00010000:2.0:1786400806.146420:0:5772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786400806.146426:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdad5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:97b0324f-e214-4822-8711-e150ddac2a7e+4:8365:x1873176872124160:12345-0@lo:104: Request processed in 98us (2576us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400806.146432:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1786400806.146491:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1786400806.146499:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:97b0324f-e214-4822-8711-e150ddac2a7e+3:8365:x1873176872124288:12345-0@lo:104: 00010000:00010000:2.0:1786400806.146506:0:5772:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1d685 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d68c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400806.146535:0:5772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1786400806.146540:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:97b0324f-e214-4822-8711-e150ddac2a7e+3:8365:x1873176872124288:12345-0@lo:104: Request processed in 43us (2552us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400806.146554:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 10000000:00010000:0.0:1786400806.146560:0:5776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc0030a00/0x5ccaaf4f3cb1d7b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5ccaaf4f3cb1d7b9 expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400806.146572:0:5776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fc0030a00/0x5ccaaf4f3cb1d7b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5ccaaf4f3cb1d7b9 expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786400806.146579:0:5776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc0030a00/0x5ccaaf4f3cb1d7b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5ccaaf4f3cb1d7b9 expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786400806.146585:0:5776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1786400806.146634:0:5776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6fc0030a00/0x5ccaaf4f3cb1d7b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d7b9 expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400806.146640:0:5776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786400806.146662:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fc0030a00/0x5ccaaf4f3cb1d7b2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d7b9 expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400806.146669:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fc0030a00/0x5ccaaf4f3cb1d7b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d7b9 expref: -99 pid: 7483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400806.146680:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786400806.146684:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fca091000/0x5ccaaf4f3cb1d6e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d6ee expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400806.146689:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca091000 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:0.0:1786400806.146692:0:5776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fca091000/0x5ccaaf4f3cb1d6e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5ccaaf4f3cb1d6ee expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400806.146698:0:5776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fca091000/0x5ccaaf4f3cb1d6e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5ccaaf4f3cb1d6ee expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786400806.146714:0:5776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fca091000/0x5ccaaf4f3cb1d6e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5ccaaf4f3cb1d6ee expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786400806.146720:0:5776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1786400806.146736:0:5776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6fca091000/0x5ccaaf4f3cb1d6e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d6ee expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400806.146741:0:5776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786400806.146769:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fca091000/0x5ccaaf4f3cb1d6e7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d6ee expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400806.146777:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fca091000/0x5ccaaf4f3cb1d6e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d6ee expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400806.146787:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786400806.146790:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1d685 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d68c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400806.146794:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7d39600 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:0.0:1786400806.146798:0:5776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1d685 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5ccaaf4f3cb1d68c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400806.146804:0:5776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1d685 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5ccaaf4f3cb1d68c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786400806.146810:0:5776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1d685 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5ccaaf4f3cb1d68c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786400806.146815:0:5776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1786400806.146848:0:5776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1d685 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d68c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400806.146855:0:5776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786400806.146861:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1d685 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d68c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400806.146867:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1d685 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d68c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400806.146882:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400806.146883:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400806.146885:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400806.148435:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786400806.148478:0:8365:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee353480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8365:1873176872124032:0@lo:104: 00000100:00100000:2.0:1786400806.148492:0:8365:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee350700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8365:1873176872124160:0@lo:104: 00000100:00100000:2.0:1786400806.148501:0:8365:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee353800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8365:1873176872124288:0@lo:104: 00000100:00100000:1.0:1786400806.148536:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:97b0324f-e214-4822-8711-e150ddac2a7e:3306:1873176872124416:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786400806.148598:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786400806.148742:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400806.148794:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872124416 00000100:00100000:2.0:1786400806.148801:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872124416 00010000:00010000:2.0:1786400806.148837:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1d7b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d7b2 expref: 19 pid: 5783 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400806.148959:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1786400806.148970:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:97b0324f-e214-4822-8711-e150ddac2a7e+19:3306:x1873176872124416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786400806.148984:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400806.148990:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1d7b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d7b2 expref: 19 pid: 5783 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400806.149000:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1d7b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d7b2 expref: 19 pid: 5783 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400806.149017:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1d7b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d7b2 expref: 19 pid: 5783 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400806.149032:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400806.149082:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:97b0324f-e214-4822-8711-e150ddac2a7e+18:3306:x1873176872124416:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400806.149108:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1786400806.149129:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:97b0324f-e214-4822-8711-e150ddac2a7e:3306:1873176872124416:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786400806.149238:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400806.149409:0:8365:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee352300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8365:1873176872123904:192.168.204.8@tcp:104: 00010000:00010000:2.0:1786400806.149444:0:8365:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1d917 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400806.149615:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872124544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786400806.149652:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400806.149832:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850077440 00000100:00100000:1.0:1786400806.149837:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850077440 00000100:00100000:0.0:1786400806.149853:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786400806.149863:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc490b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872124672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786400806.149888:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786400806.149959:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fca091c00/0x5ccaaf4f3cb1d876 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba3f expref: 10 pid: 5783 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400806.149979:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872124544 00000100:00100000:3.0:1786400806.149984:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872124544 00000100:00100000:2.0:1786400806.149996:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872124672 00010000:00010000:3.0:1786400806.150002:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fca091800/0x5ccaaf4f3cb1d6ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d6e7 expref: 18 pid: 5781 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400806.150002:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872124672 00010000:00010000:2.0:1786400806.150024:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fc138f400/0x5ccaaf4f3cb1d68c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d685 expref: 19 pid: 5780 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400806.150025:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 22 00000100:00100000:3.0:1786400806.150037:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5fbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:2365:x1873176850077440:12345-192.168.204.8@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1786400806.150045:0:5774:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:3.0:1786400806.150049:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1786400806.150055:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1786400806.150057:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fca091c00/0x5ccaaf4f3cb1d876 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba3f expref: 10 pid: 5783 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400806.150070:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fca091c00/0x5ccaaf4f3cb1d876 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba3f expref: 10 pid: 5783 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400806.150129:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fca091c00/0x5ccaaf4f3cb1d876 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba3f expref: 10 pid: 5783 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400806.150149:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400806.150254:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1786400806.150263:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4908e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:97b0324f-e214-4822-8711-e150ddac2a7e+19:3308:x1873176872124544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786400806.150272:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400806.150277:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fca091800/0x5ccaaf4f3cb1d6ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d6e7 expref: 19 pid: 5781 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400806.150286:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fca091800/0x5ccaaf4f3cb1d6ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d6e7 expref: 19 pid: 5781 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400806.150296:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fca091800/0x5ccaaf4f3cb1d6ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d6e7 expref: 19 pid: 5781 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400806.150316:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400806.150345:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4908e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:97b0324f-e214-4822-8711-e150ddac2a7e+18:3308:x1873176872124544:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400806.150354:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1786400806.150358:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5fbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+9:2365:x1873176850077440:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 319us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400806.150371:0:5774:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1786400806.150421:0:5775:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1786400806.150449:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 22 00000100:00100000:0.0:1786400806.150514:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1786400806.150523:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4908000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:97b0324f-e214-4822-8711-e150ddac2a7e+17:3308:x1873176872124672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786400806.150532:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400806.150536:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fc138f400/0x5ccaaf4f3cb1d68c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d685 expref: 17 pid: 5780 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400806.150546:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fc138f400/0x5ccaaf4f3cb1d68c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d685 expref: 17 pid: 5780 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400806.150557:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc138f400/0x5ccaaf4f3cb1d68c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d685 expref: 17 pid: 5780 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400806.150568:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1d917 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400806.150576:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1d917 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400806.150596:0:5774:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1d917 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400806.150603:0:5774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1d917 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400806.150622:0:5774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1d917 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400806.150630:0:5774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1d917 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400806.150646:0:5774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7d38e00 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:0.0:1786400806.150651:0:5774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1d917 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400806.150660:0:5774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1d917 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400806.150804:0:5774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1d917 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400806.150814:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400806.150840:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4908000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:97b0324f-e214-4822-8711-e150ddac2a7e+16:3308:x1873176872124672:12345-0@lo:103:ldlm_bl.0 Request processed in 319us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400806.150847:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1786400806.151138:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc490b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872124672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786400806.151148:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872124544:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786400806.151217:0:8365:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1d917 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400806.151304:0:8365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1d917 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400806.151311:0:8365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1d917 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400806.639892:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786400806.639920:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc490b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872124800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786400806.639998:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400806.652558:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872124800 00000100:00100000:2.0:1786400806.652575:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872124800 00000100:00100000:2.0:1786400806.653059:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1786400806.653074:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872124800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786400806.653124:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400806.653200:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872124800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (13201us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400806.653206:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1786400806.653245:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fc490b800 x1873176872124800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400822 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400806.653264:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc490b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872124800:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1786400806.659016:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786400806.830334:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400806.841581:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400806.841689:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850077568 00000100:00100000:3.0:1786400806.841699:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850077568 00000100:00100000:3.0:1786400806.841795:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 170 00000100:00100000:3.0:1786400806.841806:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+9:5580:x1873176850077568:12345-192.168.204.8@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786400806.841824:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400806.841845:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1d91e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6ba7e expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400806.841873:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1d91e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba7e expref: 10 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400806.841883:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1d91e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba7e expref: 10 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400806.841892:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7d38e00, rc 0) 00000100:00100000:3.0:1786400806.841966:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:5580:x1873176850077568:12345-192.168.204.8@tcp:101:ll_cfg_requeue.0 Request processed in 162us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400806.841973:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 170 00000100:00100000:2.0:1786400806.852351:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400806.855126:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850077696 00000100:00100000:0.0:1786400806.855142:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850077696 00000100:00100000:0.0:1786400806.855270:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 171 00000100:00100000:0.0:1786400806.855282:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:5580:x1873176850077696:12345-192.168.204.8@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786400806.855589:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:5580:x1873176850077696:12345-192.168.204.8@tcp:501:ll_cfg_requeue.0 Request processed in 310us (3248us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400806.855597:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 171 00000100:00100000:0.0:1786400806.873399:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400806.873827:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850077824 00000100:00100000:3.0:1786400806.873837:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850077824 00000100:00100000:3.0:1786400806.874022:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 172 00000100:00100000:3.0:1786400806.874032:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:5580:x1873176850077824:12345-192.168.204.8@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786400806.874302:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:5580:x1873176850077824:12345-192.168.204.8@tcp:503:ll_cfg_requeue.0 Request processed in 270us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400806.874310:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 172 00000100:00100000:1.0:1786400806.896060:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400806.896532:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850077952 00000100:00100000:0.0:1786400806.896543:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850077952 00000100:00100000:0.0:1786400806.896643:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 173 00000100:00100000:0.0:1786400806.896654:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:6111:x1873176850077952:12345-192.168.204.8@tcp:502:llog_process_th.0 00000100:00100000:0.0:1786400806.897266:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:6111:x1873176850077952:12345-192.168.204.8@tcp:502:llog_process_th.0 Request processed in 612us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400806.897276:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 173 00000100:00100000:0.0:1786400806.900724:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400806.900962:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850078080 00000100:00100000:2.0:1786400806.900973:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850078080 00000100:00100000:2.0:1786400806.901031:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 174 00000100:00100000:2.0:1786400806.901042:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:6111:x1873176850078080:12345-192.168.204.8@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786400806.901352:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:6111:x1873176850078080:12345-192.168.204.8@tcp:502:llog_process_th.0 Request processed in 311us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400806.901360:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 174 00000100:00100000:1.0:1786400807.151333:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873176872125056:0@lo:400:kworker.0 00000100:00100000:1.0:1786400807.151398:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400807.151546:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:97b0324f-e214-4822-8711-e150ddac2a7e:3307:1873176872124928:0@lo:400:kworker.0 00000100:00100000:2.0:1786400807.151582:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400807.151606:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872125440:0@lo:400:kworker.0 00000100:00100000:2.0:1786400807.151630:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400807.151651:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786400807.151657:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1873176872125312:0@lo:400:kworker.0 00000100:00100000:2.0:1786400807.151679:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400807.151705:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872125056 00000100:00100000:2.0:1786400807.151712:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872125056 00000100:00100000:2.0:1786400807.152537:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872125312 00000100:00100000:2.0:1786400807.152543:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872125312 00000100:00100000:2.0:1786400807.152573:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1786400807.152582:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873176872125056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400807.152635:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873176872125056:12345-0@lo:400:kworker.0 Request processed in 55us (1237us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400807.152642:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1786400807.152657:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1786400807.152678:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1873176872125312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400807.152714:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1873176872125312:12345-0@lo:400:kworker.0 Request processed in 38us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400807.152720:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1786400807.152785:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872124928 00000100:00100000:2.0:1786400807.152790:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872124928 00000100:00100000:2.0:1786400807.152819:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1786400807.152825:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+16:3307:x1873176872124928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400807.152855:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+16:3307:x1873176872124928:12345-0@lo:400:kworker.0 Request processed in 30us (1272us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400807.152861:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1786400807.152889:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872125440 00000100:00100000:2.0:1786400807.152892:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872125440 00000100:00100000:2.0:1786400807.152921:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1786400807.152929:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5fbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872125440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400807.152957:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5fbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872125440:12345-0@lo:400:kworker.0 Request processed in 30us (1326us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400807.152962:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1786400807.152984:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786400807.152988:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786400807.153276:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1873176872125312:0@lo:400:kworker.0 00000100:00100000:2.0:1786400807.153287:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:97b0324f-e214-4822-8711-e150ddac2a7e:3307:1873176872124928:0@lo:400:kworker.0 00010000:00080000:2.0:1786400807.153299:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff5f98a80 x1873176872125440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400807.153310:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872125440:0@lo:400:kworker.0 00000100:00100000:2.0:1786400807.153379:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873176872125184:0@lo:400:kworker.0 00000100:00100000:2.0:1786400807.153409:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400807.153438:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872125184 00000100:00100000:2.0:1786400807.153442:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872125184 00000100:00100000:2.0:1786400807.153468:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1786400807.153474:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5fbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873176872125184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400807.153505:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5fbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873176872125184:12345-0@lo:400:kworker.0 Request processed in 31us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400807.153510:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1786400807.153525:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786400807.153540:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873176872125184:0@lo:400:kworker.0 00000100:00100000:1.0:1786400807.155264:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873176872125056:0@lo:400:kworker.0 00000100:00100000:3.0:1786400807.156045:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786400807.156059:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872125568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786400807.156130:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400807.160924:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872125568 00000100:00100000:2.0:1786400807.160939:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872125568 00000100:00100000:2.0:1786400807.160997:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1786400807.161008:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872125568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786400807.161050:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400807.161155:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872125568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 149us (5025us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400807.161163:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1786400807.161573:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff692df80 x1873176872125568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400807.161593:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872125568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786400807.478112:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400807.478147:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400807.478172:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400807.478551:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850078336 00000100:00100000:3.0:1786400807.478561:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850078336 00000100:00100000:3.0:1786400807.478614:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850078464 00000100:00100000:3.0:1786400807.478617:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850078464 00000100:00100000:3.0:1786400807.478639:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 13 00000100:00100000:3.0:1786400807.478648:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5fbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+5:2365:x1873176850078336:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:3.0:1786400807.478731:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5fbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+5:2365:x1873176850078336:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 83us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400807.478743:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 13 00000100:00100000:3.0:1786400807.478761:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14 00000100:00100000:3.0:1786400807.478768:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+5:2364:x1873176850078464:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:3.0:1786400807.478792:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+5:2364:x1873176850078464:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 26us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400807.478799:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14 00000100:00100000:3.0:1786400807.479156:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850078208 00000100:00100000:3.0:1786400807.479167:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850078208 00000100:00100000:3.0:1786400807.479200:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 31 00000100:00100000:3.0:1786400807.479207:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5fbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+6:2364:x1873176850078208:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:3.0:1786400807.479238:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5fbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+6:2364:x1873176850078208:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 31us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400807.479244:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 31 00000100:00080000:2.0:1786400807.480692:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786400807.480701:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786400807.480703:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1786400807.855290:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1786400808.046591:0:5785:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1786400808.046600:0:5785:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6ec470a000 from 4 10000000:01000000:0.0:1786400808.046605:0:5785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1786400808.046654:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1d925 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400808.046666:0:5785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1d925 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400808.046677:0:5785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1d925 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400808.046702:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc490a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872125696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786400808.046782:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400808.047155:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff5f87000 going to sleep for 11 seconds 00000100:00100000:2.0:1786400808.047250:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872125696 00000100:00100000:2.0:1786400808.047258:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872125696 00000100:00100000:2.0:1786400808.047408:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1786400808.047420:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+16:5785:x1873176872125696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786400808.047434:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400808.047448:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fc4e5c800/0x5ccaaf4f3cb1d92c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d925 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400808.047472:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc4e5c800/0x5ccaaf4f3cb1d92c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d925 expref: 17 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400808.047481:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fc4e5c800/0x5ccaaf4f3cb1d92c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d925 expref: 17 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400808.047490:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc4e5c800, rc 0) 00000100:00100000:2.0:1786400808.047601:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+17:5785:x1873176872125696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400808.047609:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1786400808.047673:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc490a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872125696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786400808.047687:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1d925 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d92c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400808.047698:0:5785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1d925 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d92c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400808.047763:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872125824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786400808.047791:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400808.047889:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd0beb780 going to sleep for 11 seconds 00000100:00100000:0.0:1786400808.047968:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872125824 00000100:00100000:0.0:1786400808.047973:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872125824 00000100:00100000:0.0:1786400808.047995:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1786400808.048002:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+17:5785:x1873176872125824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786400808.048278:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+17:5785:x1873176872125824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 275us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400808.048286:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1786400808.048497:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872125824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786400808.048530:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872125952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786400808.048568:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400808.048600:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd0beb780 going to sleep for 11 seconds 00000100:00100000:0.0:1786400808.048654:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872125952 00000100:00100000:0.0:1786400808.048658:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872125952 00000100:00100000:0.0:1786400808.048676:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1786400808.048682:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+17:5785:x1873176872125952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786400808.048900:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+17:5785:x1873176872125952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 216us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400808.048906:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1786400808.049155:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872125952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786400808.049573:0:8439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc4909f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:8439:1873176872126080:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786400808.049607:0:8439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400808.049667:0:8439:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff5f87840 going to sleep for 11 seconds 00000100:00100000:2.0:1786400808.049697:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872126080 00000100:00100000:2.0:1786400808.049702:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872126080 00000100:00100000:2.0:1786400808.049773:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1786400808.049780:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+17:8439:x1873176872126080:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786400808.049938:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+17:8439:x1873176872126080:12345-0@lo:502:llog_process_th.0 Request processed in 158us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400808.049944:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1786400808.050015:0:8439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc4909f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:8439:1873176872126080:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1786400808.050037:0:8439:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786400808.050051:0:8439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400808.050054:0:8439:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1786400808.050167:0:8439:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d6ec470a000 00000020:00000080:1.0:1786400808.050170:0:8439:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1786400808.050237:0:8439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f98e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:8439:1873176872126208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786400808.050275:0:8439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400808.053621:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872126208 00000100:00100000:0.0:1786400808.053633:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872126208 00000100:00100000:0.0:1786400808.053673:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1786400808.053681:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+17:8439:x1873176872126208:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786400808.053909:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+17:8439:x1873176872126208:12345-0@lo:502:llog_process_th.0 Request processed in 228us (3632us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400808.053917:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1786400808.054052:0:8439:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc9790b40 going to sleep for 11 seconds 00000100:00100000:1.0:1786400808.054075:0:8439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f98e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:8439:1873176872126208:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1786400808.054169:0:8439:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786400808.054177:0:8439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400808.054179:0:8439:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1786400808.054185:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1786400808.054582:0:5785:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1786400808.054599:0:5785:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1786400808.054609:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1d925 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d92c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400808.054626:0:5785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1d925 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d92c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400808.054704:0:5785:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1786400808.054718:0:5785:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6fc49f0000 from 4 10000000:01000000:1.0:1786400808.054721:0:5785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1786400808.054753:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f800/0x5ccaaf4f3cb1d933 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400808.054762:0:5785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f800/0x5ccaaf4f3cb1d933 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400808.054771:0:5785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f800/0x5ccaaf4f3cb1d933 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400808.054792:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f98e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872126336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786400808.054834:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400808.054902:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffde64f00 going to sleep for 11 seconds 00000100:00100000:0.0:1786400808.054944:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872126336 00000100:00100000:0.0:1786400808.054952:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872126336 00000100:00100000:1.0:1786400808.055121:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1786400808.055132:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+17:5785:x1873176872126336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786400808.055152:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400808.055164:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d93a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d933 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400808.055185:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d93a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d933 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400808.055195:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d93a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d933 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400808.055204:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138f600, rc 0) 00000100:00100000:1.0:1786400808.055285:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+18:5785:x1873176872126336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400808.055292:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1786400808.055455:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f98e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872126336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786400808.055468:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f800/0x5ccaaf4f3cb1d933 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d93a expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400808.055476:0:5785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f800/0x5ccaaf4f3cb1d933 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d93a expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400808.055522:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc490aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872126464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786400808.055548:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400808.055616:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff5f87e40 going to sleep for 11 seconds 00000100:00100000:1.0:1786400808.055649:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872126464 00000100:00100000:1.0:1786400808.055653:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872126464 00000100:00100000:1.0:1786400808.055769:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1786400808.055777:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+18:5785:x1873176872126464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786400808.056038:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+18:5785:x1873176872126464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 262us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400808.056045:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1786400808.057162:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc490aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872126464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786400808.057206:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f9b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872126592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786400808.057259:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400808.058413:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffde64cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400808.058468:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872126592 00000100:00100000:0.0:1786400808.058478:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872126592 00000100:00100000:0.0:1786400808.058566:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1786400808.058576:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+18:5785:x1873176872126592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786400808.058811:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+18:5785:x1873176872126592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 237us (1551us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400808.058819:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1786400808.059500:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f9b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872126592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786400808.069923:0:8442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee353800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:8442:1873176872126720:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786400808.070005:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400808.070051:0:8442:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc48ca300 going to sleep for 11 seconds 00000100:00100000:1.0:1786400808.071844:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872126720 00000100:00100000:1.0:1786400808.071857:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872126720 00000100:00100000:1.0:1786400808.071919:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1786400808.071930:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+18:8442:x1873176872126720:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786400808.073369:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+18:8442:x1873176872126720:12345-0@lo:502:llog_process_th.0 Request processed in 1438us (3360us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400808.073381:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1786400808.074853:0:8442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee353800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:8442:1873176872126720:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1786400808.074912:0:8442:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786400808.074923:0:8442:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786400808.074925:0:8442:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1786400808.074934:0:8442:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d6fc49f0000 00000020:00000080:2.0:1786400808.074937:0:8442:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1786400808.075197:0:8442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee353800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:8442:1873176872126848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786400808.075258:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400808.075290:0:8442:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc48ca300 going to sleep for 11 seconds 00000100:00100000:0.0:1786400808.075704:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872126848 00000100:00100000:0.0:1786400808.075726:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872126848 00000100:00100000:0.0:1786400808.075778:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1786400808.075787:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+18:8442:x1873176872126848:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786400808.075991:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+18:8442:x1873176872126848:12345-0@lo:502:llog_process_th.0 Request processed in 205us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400808.075999:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1786400808.076405:0:8442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee353800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:8442:1873176872126848:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1786400808.076427:0:8442:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786400808.076433:0:8442:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786400808.076435:0:8442:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1786400808.076440:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1786400808.077156:0:5785:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1786400808.077176:0:5785:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1786400808.077185:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f800/0x5ccaaf4f3cb1d933 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d93a expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400808.077196:0:5785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f800/0x5ccaaf4f3cb1d933 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d93a expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786400808.077206:0:5785:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1786400808.077209:0:5785:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6fc307d800 from 4 10000000:01000000:0.0:1786400808.077211:0:5785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1786400808.077454:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1d941 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400808.077464:0:5785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1d941 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400808.077475:0:5785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1d941 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400808.077495:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc490ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872126976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786400808.077544:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400808.077572:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff5f87840 going to sleep for 11 seconds 00000100:00100000:2.0:1786400808.079282:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872126976 00000100:00100000:2.0:1786400808.079293:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872126976 00000100:00100000:2.0:1786400808.079339:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1786400808.079349:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+18:5785:x1873176872126976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786400808.079365:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400808.079382:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1d948 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d941 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400808.079407:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1d948 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d941 expref: 19 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400808.079418:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1d948 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d941 expref: 19 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400808.079427:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc4e5d000, rc 0) 00000100:00100000:2.0:1786400808.079499:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+19:5785:x1873176872126976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (1954us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400808.079518:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1786400808.081108:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc490ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872126976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786400808.081141:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1d941 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d948 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400808.081154:0:5785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1d941 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d948 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400808.081252:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f9b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872127104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786400808.081304:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400808.081342:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffde64b40 going to sleep for 11 seconds 00000100:00100000:2.0:1786400808.082536:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872127104 00000100:00100000:2.0:1786400808.082546:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872127104 00000100:00100000:2.0:1786400808.082594:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1786400808.082603:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+19:5785:x1873176872127104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786400808.087118:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+19:5785:x1873176872127104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4507us (5805us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400808.087134:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1786400808.087153:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f9b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872127104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786400808.087210:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f9b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872127232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786400808.087255:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400808.087289:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffde64b40 going to sleep for 11 seconds 00000100:00100000:2.0:1786400808.094866:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872127232 00000100:00100000:2.0:1786400808.094882:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872127232 00000100:00100000:2.0:1786400808.094975:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1786400808.094985:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+19:5785:x1873176872127232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786400808.096839:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+19:5785:x1873176872127232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1845us (9573us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400808.096853:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1786400808.096949:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f9b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872127232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786400808.098340:0:8443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f98700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:8443:1873176872127360:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786400808.098408:0:8443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400808.098650:0:8443:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffde64300 going to sleep for 11 seconds 00000100:00100000:2.0:1786400808.098751:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872127360 00000100:00100000:2.0:1786400808.098757:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872127360 00000100:00100000:2.0:1786400808.098838:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1786400808.098848:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+19:8443:x1873176872127360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786400808.099303:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+19:8443:x1873176872127360:12345-0@lo:502:llog_process_th.0 Request processed in 455us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400808.099312:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1786400808.101964:0:8443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f98700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:8443:1873176872127360:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1786400808.103342:0:8443:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786400808.103356:0:8443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786400808.103358:0:8443:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1786400808.103366:0:8443:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d6fc307d800 00000020:00000080:0.0:1786400808.103376:0:8443:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1786400808.103461:0:8443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc4908380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:8443:1873176872127488:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786400808.103533:0:8443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400808.103565:0:8443:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff5f87600 going to sleep for 11 seconds 00000100:00100000:2.0:1786400808.103844:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872127488 00000100:00100000:2.0:1786400808.103853:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872127488 00000100:00100000:2.0:1786400808.103907:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1786400808.103917:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+19:8443:x1873176872127488:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786400808.110066:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+19:8443:x1873176872127488:12345-0@lo:502:llog_process_th.0 Request processed in 6142us (6525us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400808.110119:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1786400808.110812:0:8443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc4908380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:8443:1873176872127488:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1786400808.110854:0:8443:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786400808.110863:0:8443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786400808.110865:0:8443:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1786400808.110872:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1786400808.111798:0:5785:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1786400808.111830:0:5785:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1786400808.111841:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1d941 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d948 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400808.111854:0:5785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1d941 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d948 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400808.878663:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400809.904282:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400810.926271:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400811.760512:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786400811.760535:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872127616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786400811.760604:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400811.760681:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872127616 00000100:00100000:1.0:1786400811.760689:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872127616 00000100:00100000:1.0:1786400811.760748:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1786400811.760758:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872127616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786400811.760794:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400811.760838:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872127616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400811.760845:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1786400811.760864:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1786400811.760894:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff5f98700 x1873176872127616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400827 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400811.760911:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872127616:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786400811.950201:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400812.273793:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786400812.273818:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872127744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786400812.273887:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400812.281257:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872127744 00000100:00100000:2.0:1786400812.281271:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872127744 00000100:00100000:0.0:1786400812.281763:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc490a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873176872128256:0@lo:400:kworker.0 00000100:00100000:0.0:1786400812.281830:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400812.281877:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786400812.281883:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc4908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:97b0324f-e214-4822-8711-e150ddac2a7e:3306:1873176872127872:0@lo:400:kworker.0 00000100:00100000:0.0:1786400812.281913:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400812.281943:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc490bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873176872128000:0@lo:400:kworker.0 00000100:00100000:2.0:1786400812.282066:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1786400812.282080:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee353800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872127744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786400812.282144:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400812.282189:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee353800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872127744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (8301us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400812.282197:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1786400812.282221:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786400812.282247:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872128256 00000100:00100000:2.0:1786400812.282262:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872128256 00000100:00100000:2.0:1786400812.282295:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1786400812.282303:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873176872128256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400812.283294:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873176872128256:12345-0@lo:400:kworker.0 Request processed in 990us (1461us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400812.283302:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1786400812.283587:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400812.283616:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786400812.283635:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc490b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873176872128128:0@lo:400:kworker.0 00000100:00100000:0.0:1786400812.283659:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400812.283695:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872128000 00000100:00100000:0.0:1786400812.283701:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872128000 00010000:00080000:1.0:1786400812.283811:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff692df80 x1873176872127744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400812.283830:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872127744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786400812.283892:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872128128 00000100:00100000:2.0:1786400812.283896:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872128128 00000100:00100000:0.0:1786400812.284521:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1786400812.284532:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc490b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873176872128000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400812.284584:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc490b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873176872128000:12345-0@lo:400:kworker.0 Request processed in 55us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400812.284590:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1786400812.284696:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc490bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873176872128000:0@lo:400:kworker.0 00000100:00100000:2.0:1786400812.284935:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1786400812.284945:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873176872128128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400812.286385:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873176872128128:12345-0@lo:400:kworker.0 Request processed in 1438us (2720us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400812.286397:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1786400812.286616:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc490b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873176872128128:0@lo:400:kworker.0 00000100:00100000:2.0:1786400812.291219:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872127872 00000100:00100000:2.0:1786400812.291234:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872127872 00000100:00100000:2.0:1786400812.291797:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1786400812.291809:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+19:3306:x1873176872127872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400812.291892:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+19:3306:x1873176872127872:12345-0@lo:400:kworker.0 Request processed in 86us (9977us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400812.291899:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00080000:2.0:1786400812.291939:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400812.293700:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc4908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:97b0324f-e214-4822-8711-e150ddac2a7e:3306:1873176872127872:0@lo:400:kworker.0 00000100:00100000:1.0:1786400812.293723:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc490a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873176872128256:0@lo:400:kworker.0 00000100:00100000:1.0:1786400812.600639:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400812.600724:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400812.600751:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400812.600778:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400812.600805:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850078848 00000100:00100000:1.0:1786400812.600814:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850078848 00000100:00100000:1.0:1786400812.600866:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850078976 00000100:00100000:1.0:1786400812.600869:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850078976 00000100:00100000:0.0:1786400812.600971:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850078592 00000100:00100000:0.0:1786400812.600976:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850078592 00000100:00100000:0.0:1786400812.601007:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 192 00000100:00100000:0.0:1786400812.601015:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:2365:x1873176850078592:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786400812.601117:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:2365:x1873176850078592:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 101us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400812.601124:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 192 00000100:00100000:0.0:1786400812.601157:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850078720 00000100:00100000:0.0:1786400812.601160:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850078720 00000100:00100000:0.0:1786400812.601191:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 35 00000100:00100000:0.0:1786400812.601197:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+6:2365:x1873176850078720:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786400812.601235:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+6:2365:x1873176850078720:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 38us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400812.601242:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 35 00000100:00080000:0.0:1786400812.601391:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786400812.601397:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786400812.601399:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786400812.601937:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 15 00000100:00100000:1.0:1786400812.601951:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+5:2365:x1873176850078848:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:1.0:1786400812.601993:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+5:2365:x1873176850078848:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 47us (1269us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400812.603932:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 16 00000100:00100000:0.0:1786400812.603956:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+5:2365:x1873176850078976:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786400812.604025:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+5:2365:x1873176850078976:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 80us (3245us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400812.604033:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 16 00000100:00100000:1.0:1786400812.608242:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 15 00010000:00010000:2.0:1786400812.977555:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786400813.035864:0:8669:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg408-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1786400813.998211:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400815.028674:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400816.046211:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400816.879496:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc4909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872128384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786400816.879580:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400816.879669:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872128384 00000100:00100000:0.0:1786400816.879677:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872128384 00000100:00100000:0.0:1786400816.879738:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1786400816.879747:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4908a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872128384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786400816.880467:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786400816.880551:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4908a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872128384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 804us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400816.880560:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1786400816.880585:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1786400816.880673:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fc4909c00 x1873176872128384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400832 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400816.880693:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc4909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872128384:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1786400817.070402:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400817.390399:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc4909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873176872128640:0@lo:400:kworker.0 00000100:00100000:0.0:1786400817.390470:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400817.390538:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1786400817.390544:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc4909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:97b0324f-e214-4822-8711-e150ddac2a7e:3309:1873176872128512:0@lo:400:kworker.0 00000100:00100000:0.0:1786400817.390572:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400817.390595:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc490b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872129024:0@lo:400:kworker.0 00000100:00100000:0.0:1786400817.390616:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400817.390641:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc490a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872128768:0@lo:400:kworker.0 00000100:00100000:0.0:1786400817.390663:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400817.390679:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786400817.390684:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc4908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873176872128896:0@lo:400:kworker.0 00000100:00100000:0.0:1786400817.390705:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400817.390733:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872128512 00000100:00100000:0.0:1786400817.390740:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872128512 00000100:00100000:0.0:1786400817.390779:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1786400817.390787:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+19:3309:x1873176872128512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400817.390905:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+19:3309:x1873176872128512:12345-0@lo:400:kworker.0 Request processed in 117us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400817.390913:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1786400817.390944:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872129024 00000100:00100000:0.0:1786400817.390947:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872129024 00000100:00100000:0.0:1786400817.390978:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1786400817.390984:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872129024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400817.391022:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872129024:12345-0@lo:400:kworker.0 Request processed in 39us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400817.391029:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1786400817.391046:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872128640 00000100:00100000:0.0:1786400817.391049:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872128640 00000100:00100000:0.0:1786400817.391069:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872128768 00000100:00100000:0.0:1786400817.391071:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872128768 00000100:00100000:0.0:1786400817.391082:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872128896 00000100:00100000:0.0:1786400817.391102:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872128896 00000100:00100000:0.0:1786400817.391116:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1786400817.391121:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc490bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873176872128640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400817.391148:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc490bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873176872128640:12345-0@lo:400:kworker.0 Request processed in 27us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400817.391154:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1786400817.391164:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1786400817.391169:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc490ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872128768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400817.391199:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc490ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872128768:12345-0@lo:400:kworker.0 Request processed in 29us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400817.391205:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1786400817.391215:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1786400817.391220:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc490aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873176872128896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400817.391245:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc490aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873176872128896:12345-0@lo:400:kworker.0 Request processed in 25us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400817.391251:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1786400817.391272:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786400817.391275:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786400817.391308:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc4908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873176872128896:0@lo:400:kworker.0 00000100:00100000:0.0:1786400817.391327:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc490a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872128768:0@lo:400:kworker.0 00000100:00100000:0.0:1786400817.391354:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc4909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:97b0324f-e214-4822-8711-e150ddac2a7e:3309:1873176872128512:0@lo:400:kworker.0 00010000:00080000:0.0:1786400817.391366:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fc490b480 x1873176872129024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400817.391375:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc490b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872129024:0@lo:400:kworker.0 00000100:00100000:0.0:1786400817.391384:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc4909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873176872128640:0@lo:400:kworker.0 00000100:00100000:2.0:1786400817.391922:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786400817.391932:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee350700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872129152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786400817.391967:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400817.392008:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872129152 00000100:00100000:2.0:1786400817.392013:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872129152 00000100:00100000:2.0:1786400817.392043:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1786400817.392049:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872129152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786400817.392076:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400817.392129:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872129152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400817.392135:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1786400817.392164:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fee350700 x1873176872129152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400833 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400817.392178:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee350700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872129152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786400817.726217:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400817.726275:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400817.726303:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400817.726331:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400817.726363:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850079104 00000100:00100000:1.0:1786400817.726373:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850079104 00000100:00100000:1.0:1786400817.726428:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 194 00000100:00100000:1.0:1786400817.726438:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:2363:x1873176850079104:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:1.0:1786400817.726513:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:2363:x1873176850079104:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 77us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400817.726539:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 194 00000100:00100000:1.0:1786400817.726574:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850079360 00000100:00100000:1.0:1786400817.726578:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850079360 00000100:00100000:1.0:1786400817.726613:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850079488 00000100:00100000:1.0:1786400817.726616:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850079488 00000100:00100000:1.0:1786400817.726638:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 10 00000100:00100000:1.0:1786400817.726643:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+5:2361:x1873176850079360:12345-192.168.204.8@tcp:9:kworker.0 00000020:00000080:1.0:1786400817.726672:0:6593:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5ccaaf4f3cb1d884 00000100:00080000:1.0:1786400817.726683:0:6593:0:(import.c:65:import_set_state_nolock()) ffff9d6ff5fcf800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1786400817.726719:0:6593:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1786400817.727041:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+2:2361:x1873176850079360:12345-192.168.204.8@tcp:9:kworker.0 Request processed in 396us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400817.727048:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 10 00000100:00100000:1.0:1786400817.727061:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 11 00000100:00100000:1.0:1786400817.727067:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+5:2361:x1873176850079488:12345-192.168.204.8@tcp:9:kworker.0 00000020:00000080:1.0:1786400817.727080:0:6593:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5ccaaf4f3cb1d88b 00000100:00080000:1.0:1786400817.727109:0:6593:0:(import.c:65:import_set_state_nolock()) ffff9d6fc849d800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1786400817.727128:0:6593:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1786400817.727310:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+2:2361:x1873176850079488:12345-192.168.204.8@tcp:9:kworker.0 Request processed in 242us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400817.727317:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 11 00000100:00100000:1.0:1786400817.727339:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850079232 00000100:00100000:1.0:1786400817.727343:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850079232 00000100:00100000:1.0:1786400817.727375:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 39 00000100:00100000:1.0:1786400817.727381:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+6:2363:x1873176850079232:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:1.0:1786400817.727421:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+6:2363:x1873176850079232:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 39us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400817.727427:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 39 00000100:00080000:1.0:1786400817.727568:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786400817.727573:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786400817.727575:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1786400817.727639:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400817.727726:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786400818.028764:0:8913:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg408-server.virtnet: executing yml_node 00010000:00010000:1.0:1786400818.097200:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400819.119829:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400820.142262:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400821.167407:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1786400821.555700:0:7501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 096c63d9-38b8-441b-8c71-343db25fe88a 00000020:00000080:0.0:1786400821.555710:0:7501:0:(genops.c:906:class_export_put()) final put ffff9d6fc849f000/096c63d9-38b8-441b-8c71-343db25fe88a 00000020:00000080:0.0:1786400821.555739:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc849f000/096c63d9-38b8-441b-8c71-343db25fe88a for lustre-OST0001 00000020:00000080:0.0:1786400821.555782:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6fc849d800 for lustre-OST0001 00000100:00100000:0.0:1786400821.999309:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786400821.999334:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc4909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872129280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786400821.999402:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400821.999486:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872129280 00000100:00100000:0.0:1786400821.999494:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872129280 00000100:00100000:0.0:1786400821.999547:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1786400821.999556:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc490b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872129280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786400821.999590:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1786400822.001666:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786400822.001942:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc490b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872129280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2381us (2535us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400822.001955:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1786400822.002470:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fc4909c00 x1873176872129280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400837 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400822.002492:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc4909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872129280:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786400822.190271:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400822.510645:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc4908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872129792:0@lo:400:kworker.0 00000100:00100000:0.0:1786400822.510645:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc490a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873176872129664:0@lo:400:kworker.0 00000100:00100000:1.0:1786400822.510720:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee350700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872129408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786400822.510767:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc4909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872129536:0@lo:400:kworker.0 00000100:00100000:2.0:1786400822.510807:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400822.510838:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400822.510848:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc490a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872130048:0@lo:400:kworker.0 00000100:00100000:2.0:1786400822.510871:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400822.510890:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872129536 00000100:00100000:0.0:1786400822.510897:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872129536 00000100:00100000:0.0:1786400822.510937:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1786400822.510945:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+19:3308:x1873176872129536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400822.510992:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+19:3308:x1873176872129536:12345-0@lo:400:kworker.0 Request processed in 47us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400822.510998:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1786400822.511028:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872129664 00000100:00100000:0.0:1786400822.511031:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872129664 00000100:00100000:0.0:1786400822.511058:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1786400822.511063:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc490b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873176872129664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400822.511113:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc490b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873176872129664:12345-0@lo:400:kworker.0 Request processed in 49us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400822.511119:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1786400822.511200:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400822.511675:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc4909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872129536:0@lo:400:kworker.0 00000100:00100000:0.0:1786400822.512116:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc490a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873176872129664:0@lo:400:kworker.0 00000100:00100000:0.0:1786400822.512136:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872129792 00000100:00100000:0.0:1786400822.512140:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872129792 00000100:00100000:2.0:1786400822.512238:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872130048 00000100:00100000:2.0:1786400822.512243:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872130048 00000100:00100000:2.0:1786400822.512274:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1786400822.512282:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee352680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872130048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400822.512331:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee352680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872130048:12345-0@lo:400:kworker.0 Request processed in 50us (1458us total) trans 0 rc 0/0 00000100:00080000:0.0:1786400822.512333:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786400822.512338:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1786400822.512338:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400822.512361:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1786400822.512367:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872129792:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1786400822.512370:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fc490a680 x1873176872130048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400822.512381:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc490a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872130048:0@lo:400:kworker.0 00000100:00100000:0.0:1786400822.512406:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872129792:12345-0@lo:400:kworker.0 Request processed in 39us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400822.512412:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1786400822.514184:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400822.514224:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc4909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1873176872129920:0@lo:400:kworker.0 00000100:00100000:1.0:1786400822.514262:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400822.514308:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872129920 00000100:00100000:1.0:1786400822.514314:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872129920 00000100:00100000:1.0:1786400822.514367:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1786400822.514376:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1873176872129920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400822.514435:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1873176872129920:12345-0@lo:400:kworker.0 Request processed in 47us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400822.514441:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1786400822.514473:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400822.514501:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc4909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1873176872129920:0@lo:400:kworker.0 00000100:00100000:3.0:1786400822.514801:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc4908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872129792:0@lo:400:kworker.0 00000100:00100000:0.0:1786400822.519485:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872129408 00000100:00100000:0.0:1786400822.519501:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872129408 00000100:00100000:0.0:1786400822.519809:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1786400822.519821:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872129408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786400822.519875:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786400822.519968:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872129408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (5789us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400822.519975:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1786400822.520678:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fee350700 x1873176872129408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400838 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400822.520702:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee350700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872129408:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1786400822.546534:0:6619:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 096c63d9-38b8-441b-8c71-343db25fe88a 00000020:00000080:2.0:1786400822.546544:0:6619:0:(genops.c:906:class_export_put()) final put ffff9d6ff5fc8800/096c63d9-38b8-441b-8c71-343db25fe88a 00000020:00000080:2.0:1786400822.546573:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ff5fc8800/096c63d9-38b8-441b-8c71-343db25fe88a for lustre-OST0000 00000020:00000080:2.0:1786400822.546616:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ff5fcf800 for lustre-OST0000 00000100:00100000:0.0:1786400822.834843:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400822.834937:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400822.835015:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850079616 00000100:00100000:1.0:1786400822.835025:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850079616 00000100:00100000:1.0:1786400822.835107:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 196 00000100:00100000:1.0:1786400822.835119:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:2365:x1873176850079616:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:1.0:1786400822.835326:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:2365:x1873176850079616:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 209us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400822.835335:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 196 00000100:00100000:2.0:1786400822.835529:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850079744 00000100:00100000:2.0:1786400822.835534:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850079744 00000100:00100000:2.0:1786400822.835594:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 43 00000100:00100000:2.0:1786400822.835602:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc490a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+6:2365:x1873176850079744:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:2.0:1786400822.835636:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc490a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+6:2365:x1873176850079744:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 36us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400822.835643:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 43 00000100:00080000:1.0:1786400822.836081:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1786400823.214686:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400824.239190:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786400824.405629:0:9106:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.108 00010000:00010000:2.0:1786400825.263498:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400826.286623:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400827.118534:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc4908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872130176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786400827.118609:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400827.118775:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872130176 00000100:00100000:1.0:1786400827.118786:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872130176 00000100:00100000:1.0:1786400827.118852:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1786400827.118862:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4909f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872130176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786400827.118901:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400827.121155:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4909f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872130176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2283us (2533us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400827.121170:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1786400827.121207:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1786400827.121256:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fc4908700 x1873176872130176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400843 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400827.121286:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc4908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872130176:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1786400827.261843:0:9203:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.108 00010000:00010000:3.0:1786400827.312356:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400827.630410:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872130304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786400827.630531:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400827.631352:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872130304 00000100:00100000:3.0:1786400827.631366:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872130304 00000100:00100000:3.0:1786400827.631460:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1786400827.631472:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee351f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872130304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786400827.631516:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1786400827.631568:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786400827.632388:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee351f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872130304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 912us (1850us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400827.632405:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1786400827.632444:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff692ca80 x1873176872130304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400843 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400827.632471:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872130304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786400827.632723:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873176872130560:0@lo:400:kworker.0 00000100:00100000:1.0:1786400827.632739:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873176872130688:0@lo:400:kworker.0 00000100:00100000:1.0:1786400827.632782:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400827.632826:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872130688 00000100:00100000:1.0:1786400827.632833:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872130688 00000100:00100000:3.0:1786400827.632847:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:97b0324f-e214-4822-8711-e150ddac2a7e:3307:1873176872130432:0@lo:400:kworker.0 00000100:00100000:2.0:1786400827.632892:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872130816:0@lo:400:kworker.0 00000100:00100000:1.0:1786400827.632909:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1786400827.632921:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400827.632929:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873176872130688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400827.632946:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400827.632976:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873176872130688:12345-0@lo:400:kworker.0 Request processed in 53us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400827.632982:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1786400827.633016:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873176872130688:0@lo:400:kworker.0 00000100:00100000:3.0:1786400827.633510:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1873176872130944:0@lo:400:kworker.0 00000100:00100000:3.0:1786400827.633557:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1786400827.633767:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786400827.634073:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872130432 00000100:00100000:2.0:1786400827.634112:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872130432 00000100:00100000:2.0:1786400827.634154:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1786400827.634162:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+19:3307:x1873176872130432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400827.634203:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+19:3307:x1873176872130432:12345-0@lo:400:kworker.0 Request processed in 43us (1291us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400827.634210:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1786400827.634246:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872130816 00000100:00100000:2.0:1786400827.634250:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872130816 00000100:00100000:2.0:1786400827.634287:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1786400827.634295:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee352a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872130816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400827.634307:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:97b0324f-e214-4822-8711-e150ddac2a7e:3307:1873176872130432:0@lo:400:kworker.0 00000100:00100000:2.0:1786400827.634679:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee352a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872130816:12345-0@lo:400:kworker.0 Request processed in 384us (1730us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400827.634688:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1786400827.634830:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fc97f6a00 x1873176872130816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400827.634853:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872130816:0@lo:400:kworker.0 00000100:00100000:2.0:1786400827.634897:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872130944 00000100:00100000:2.0:1786400827.634902:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872130944 00000100:00100000:2.0:1786400827.634942:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1786400827.634949:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1873176872130944:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1786400827.635048:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400827.635168:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400827.635177:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1873176872130944:12345-0@lo:400:kworker.0 Request processed in 228us (1622us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400827.635183:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1786400827.635193:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872130560 00000100:00100000:2.0:1786400827.635196:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872130560 00000100:00100000:2.0:1786400827.635218:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1786400827.635224:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc490a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873176872130560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400827.635293:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1873176872130944:0@lo:400:kworker.0 00000100:00100000:2.0:1786400827.635673:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc490a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873176872130560:12345-0@lo:400:kworker.0 Request processed in 449us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400827.635680:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1786400827.636118:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873176872130560:0@lo:400:kworker.0 00000100:00100000:1.0:1786400827.954293:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400827.954382:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400827.956131:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850080000 00000100:00100000:3.0:1786400827.956147:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850080000 00000100:00100000:3.0:1786400827.956230:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 47 00000100:00100000:3.0:1786400827.956241:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+6:2365:x1873176850080000:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:3.0:1786400827.956346:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+6:2365:x1873176850080000:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 106us (1963us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400827.956355:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 47 00000100:00080000:1.0:1786400827.956652:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786400827.963069:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850079872 00000100:00100000:2.0:1786400827.963095:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850079872 00000100:00100000:1.0:1786400827.965286:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 198 00000100:00100000:1.0:1786400827.965299:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:2365:x1873176850079872:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:1.0:1786400827.965390:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:2365:x1873176850079872:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 93us (11107us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400827.965398:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 198 00010000:00010000:3.0:1786400828.334400:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400829.361303:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1786400829.441191:0:9301:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.108 00010000:00010000:3.0:1786400830.382301:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786400831.233873:0:9349:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Aug 10 18:27:08 EDT 2026 00010000:00010000:2.0:1786400831.406341:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400832.239997:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786400832.240028:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee352d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872131072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786400832.240143:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400832.240227:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872131072 00000100:00100000:2.0:1786400832.240247:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872131072 00000100:00100000:2.0:1786400832.240325:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1786400832.240341:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee350380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872131072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786400832.240386:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400832.240452:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee350380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872131072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400832.240460:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1786400832.240497:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1786400832.240531:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fee352d80 x1873176872131072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400848 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400832.240553:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee352d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872131072:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1786400832.430301:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400832.767931:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee352d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872131200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786400832.769562:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:97b0324f-e214-4822-8711-e150ddac2a7e:3306:1873176872131328:0@lo:400:kworker.0 00000100:00100000:3.0:1786400832.769637:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400832.769700:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873176872131840:0@lo:400:kworker.0 00000100:00100000:3.0:1786400832.769727:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400832.769752:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1786400832.769759:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872131456:0@lo:400:kworker.0 00000100:00100000:3.0:1786400832.769781:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400832.769796:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872131968:0@lo:400:kworker.0 00000100:00100000:3.0:1786400832.769819:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400832.769852:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872131328 00000100:00100000:3.0:1786400832.769865:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872131328 00000100:00100000:3.0:1786400832.769905:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1786400832.769913:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+19:3306:x1873176872131328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400832.769981:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+19:3306:x1873176872131328:12345-0@lo:400:kworker.0 Request processed in 67us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400832.769988:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1786400832.770025:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872131840 00000100:00100000:3.0:1786400832.770029:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872131840 00000100:00100000:3.0:1786400832.770057:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872131456 00000100:00100000:3.0:1786400832.770060:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872131456 00000100:00100000:3.0:1786400832.770076:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1786400832.770081:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873176872131840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400832.773616:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400832.773663:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872131712:0@lo:400:kworker.0 00000100:00100000:2.0:1786400832.773695:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400832.773720:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786400832.773727:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc97f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873176872131584:0@lo:400:kworker.0 00000100:00100000:2.0:1786400832.773766:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400832.773813:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872131200 00000100:00100000:2.0:1786400832.773820:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872131200 00000100:00100000:2.0:1786400832.773883:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1786400832.773895:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872131200:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786400832.774864:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873176872131840:12345-0@lo:400:kworker.0 Request processed in 4777us (5131us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400832.774875:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1786400832.774899:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872131584 00000100:00100000:3.0:1786400832.774903:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872131584 00000100:00100000:3.0:1786400832.774928:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1786400832.775246:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee30c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872131456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400832.775289:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee30c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872131456:12345-0@lo:400:kworker.0 Request processed in 354us (5507us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400832.775295:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1786400832.775309:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1786400832.775316:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873176872131584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400832.775358:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873176872131584:12345-0@lo:400:kworker.0 Request processed in 42us (1591us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400832.775363:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1786400832.775409:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872131968 00000100:00100000:3.0:1786400832.775413:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872131968 00000100:00100000:3.0:1786400832.775437:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872131712 00000100:00100000:3.0:1786400832.775440:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872131712 00000100:00100000:3.0:1786400832.775454:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1786400832.775459:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee30ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1873176872131968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400832.775492:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee30ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1873176872131968:12345-0@lo:400:kworker.0 Request processed in 33us (5672us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400832.775498:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1786400832.775510:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1786400832.775516:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee350700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872131712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400832.775544:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee350700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872131712:12345-0@lo:400:kworker.0 Request processed in 28us (1849us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400832.775550:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1786400832.775598:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872131456:0@lo:400:kworker.0 00010000:00080000:3.0:1786400832.775611:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff5f9aa00 x1873176872131968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400832.775621:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872131968:0@lo:400:kworker.0 00000100:00100000:3.0:1786400832.775630:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:97b0324f-e214-4822-8711-e150ddac2a7e:3306:1873176872131328:0@lo:400:kworker.0 00000100:00100000:3.0:1786400832.775640:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873176872131840:0@lo:400:kworker.0 00000100:00080000:3.0:1786400832.775672:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786400832.775677:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400832.775722:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc97f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873176872131584:0@lo:400:kworker.0 00010000:00080000:3.0:1786400832.775732:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff5f99500 x1873176872131712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00000024:2.0:1786400832.776989:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400832.777053:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872131200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3159us (3438us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400832.777061:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1786400832.780850:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872131712:0@lo:400:kworker.0 00010000:00080000:3.0:1786400832.780902:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fee352d80 x1873176872131200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400848 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400832.780918:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee352d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872131200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786400833.076414:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400833.076471:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400833.076506:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850080128 00000100:00100000:1.0:1786400833.076515:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850080128 00000100:00100000:1.0:1786400833.076566:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 200 00000100:00100000:1.0:1786400833.076575:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:2365:x1873176850080128:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:1.0:1786400833.076648:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:2365:x1873176850080128:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 73us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400833.076657:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 200 00000100:00100000:0.0:1786400833.077277:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850080256 00000100:00100000:0.0:1786400833.077284:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850080256 00000100:00100000:0.0:1786400833.077337:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 51 00000100:00100000:0.0:1786400833.077346:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+6:2364:x1873176850080256:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786400833.077391:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+6:2364:x1873176850080256:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 46us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400833.077398:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 51 00000100:00080000:3.0:1786400833.081857:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786400833.454465:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400834.479257:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400835.502368:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400836.526465:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400837.363010:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786400837.363033:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee352d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872132096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786400837.363117:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400837.363196:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872132096 00000100:00100000:3.0:1786400837.363203:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872132096 00000100:00100000:3.0:1786400837.363260:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1786400837.363269:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872132096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786400837.363304:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786400837.363347:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872132096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400837.363354:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1786400837.363375:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1786400837.363405:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fee352d80 x1873176872132096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400853 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400837.363425:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee352d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872132096:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1786400837.554257:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400837.870390:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc4984700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:97b0324f-e214-4822-8711-e150ddac2a7e:3309:1873176872132224:0@lo:400:kworker.0 00000100:00100000:3.0:1786400837.870466:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400837.870751:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872132224 00000100:00100000:1.0:1786400837.870766:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872132224 00000100:00100000:1.0:1786400837.870829:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1786400837.870838:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+19:3309:x1873176872132224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400837.871494:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc4986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872132608:0@lo:400:kworker.0 00000100:00100000:0.0:1786400837.871532:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400837.871745:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+19:3309:x1873176872132224:12345-0@lo:400:kworker.0 Request processed in 907us (1278us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400837.871754:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1786400837.871835:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc4984700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:97b0324f-e214-4822-8711-e150ddac2a7e:3309:1873176872132224:0@lo:400:kworker.0 00000100:00100000:3.0:1786400837.871864:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc4987b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872132352:0@lo:400:kworker.0 00000100:00100000:3.0:1786400837.871986:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400837.872190:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786400837.872197:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc4987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872132480:0@lo:400:kworker.0 00000100:00100000:3.0:1786400837.872221:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400837.872345:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786400837.872353:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc4985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873176872132736:0@lo:400:kworker.0 00000100:00100000:3.0:1786400837.872660:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc4987100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872132864:0@lo:400:kworker.0 00000100:00100000:3.0:1786400837.872688:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400837.872784:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872132608 00000100:00100000:3.0:1786400837.872789:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872132608 00000100:00100000:3.0:1786400837.872826:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872132864 00000100:00100000:3.0:1786400837.872829:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872132864 00000100:00100000:3.0:1786400837.872856:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1786400837.872865:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4909500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872132608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400837.873436:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400837.873595:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4909500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872132608:12345-0@lo:400:kworker.0 Request processed in 730us (2061us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400837.873604:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1786400837.873628:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1786400837.873636:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee352d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872132864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400837.873668:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee352d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872132864:12345-0@lo:400:kworker.0 Request processed in 34us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400837.873674:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1786400837.873719:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd5b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872132992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786400837.873748:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1786400837.873792:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fc4987100 x1873176872132864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400837.873822:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc4987100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872132864:0@lo:400:kworker.0 00000100:00080000:3.0:1786400837.873850:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786400837.874946:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872132992 00000100:00100000:3.0:1786400837.874956:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872132992 00000100:00100000:3.0:1786400837.874996:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1786400837.875004:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd5bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872132992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786400837.875048:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786400837.875130:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd5bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872132992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400837.875136:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1786400837.875182:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ffd5b8700 x1873176872132992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400853 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400837.875199:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd5b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872132992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786400837.876654:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872132352 00000100:00100000:0.0:1786400837.876669:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872132352 00000100:00100000:2.0:1786400837.876756:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872132480 00000100:00100000:2.0:1786400837.876760:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872132480 00010000:00080000:1.0:1786400837.876783:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fc4986300 x1873176872132608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400837.876792:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872132736 00000100:00100000:2.0:1786400837.876795:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872132736 00000100:00100000:1.0:1786400837.876797:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc4986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872132608:0@lo:400:kworker.0 00000100:00100000:2.0:1786400837.876813:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1786400837.876821:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872132352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400837.876881:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872132352:12345-0@lo:400:kworker.0 Request processed in 61us (4894us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400837.876887:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1786400837.876900:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1786400837.876907:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872132480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400837.876935:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872132480:12345-0@lo:400:kworker.0 Request processed in 29us (4713us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400837.876941:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1786400837.876952:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1786400837.876958:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873176872132736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400837.876989:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873176872132736:12345-0@lo:400:kworker.0 Request processed in 32us (3556us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400837.877007:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1786400837.877023:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc4985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873176872132736:0@lo:400:kworker.0 00000100:00080000:2.0:1786400837.877024:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786400837.877046:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc4987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872132480:0@lo:400:kworker.0 00000100:00100000:2.0:1786400837.877057:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc4987b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872132352:0@lo:400:kworker.0 00000100:00100000:1.0:1786400838.193417:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400838.193671:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400838.193909:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850080512 00000100:00100000:0.0:1786400838.193909:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850080384 00000100:00100000:3.0:1786400838.193921:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850080512 00000100:00100000:0.0:1786400838.193921:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850080384 00000100:00100000:0.0:1786400838.193985:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 202 00000100:00100000:0.0:1786400838.193998:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:2364:x1873176850080384:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786400838.194126:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:2364:x1873176850080384:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 128us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400838.194135:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 202 00000100:00100000:3.0:1786400838.194158:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 55 00000100:00100000:3.0:1786400838.194166:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+6:2364:x1873176850080512:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:3.0:1786400838.194202:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+6:2364:x1873176850080512:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 37us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400838.194209:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 55 00000100:00080000:1.0:1786400838.194679:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1786400838.582629:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400839.598645:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400840.622299:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400841.647071:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400842.483933:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786400842.483963:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd5b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872133120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786400842.484046:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400842.484133:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872133120 00000100:00100000:2.0:1786400842.484141:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872133120 00000100:00100000:2.0:1786400842.484188:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1786400842.484200:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4987b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872133120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786400842.484236:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400842.484274:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4987b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872133120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400842.484281:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1786400842.484301:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1786400842.484333:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ffd5b8700 x1873176872133120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400858 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400842.484353:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd5b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872133120:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1786400842.671597:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400842.991370:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc4987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872133248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786400842.991436:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400842.992788:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872133248 00000100:00100000:1.0:1786400842.992798:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872133248 00000100:00100000:1.0:1786400842.992852:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1786400842.992862:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4909c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872133248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786400842.992904:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1786400842.993291:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786400842.996836:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd5ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873176872133504:0@lo:400:kworker.0 00000100:00100000:2.0:1786400842.996905:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400842.996951:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786400842.996958:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd5bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:97b0324f-e214-4822-8711-e150ddac2a7e:3307:1873176872133376:0@lo:400:kworker.0 00000100:00100000:2.0:1786400842.996998:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400842.997058:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872133376 00000100:00100000:2.0:1786400842.997066:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872133376 00000100:00100000:2.0:1786400842.997129:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1786400842.997138:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+19:3307:x1873176872133376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400842.997184:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+19:3307:x1873176872133376:12345-0@lo:400:kworker.0 Request processed in 47us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400842.997191:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1786400842.997310:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd5bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:97b0324f-e214-4822-8711-e150ddac2a7e:3307:1873176872133376:0@lo:400:kworker.0 00000100:00100000:2.0:1786400842.997342:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd5b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873176872133632:0@lo:400:kworker.0 00000100:00100000:2.0:1786400842.997365:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400842.997393:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872133504 00000100:00100000:2.0:1786400842.997397:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872133504 00000100:00100000:2.0:1786400842.997420:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872133632 00000100:00100000:2.0:1786400842.997422:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872133632 00000100:00100000:2.0:1786400842.997444:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1786400842.997450:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873176872133504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400842.997481:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873176872133504:12345-0@lo:400:kworker.0 Request processed in 32us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400842.997486:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1786400842.997496:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1786400842.997502:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873176872133632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400842.997526:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873176872133632:12345-0@lo:400:kworker.0 Request processed in 24us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400842.997531:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1786400842.997546:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786400842.997573:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd5b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873176872133632:0@lo:400:kworker.0 00000100:00100000:2.0:1786400842.997592:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd5ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873176872133504:0@lo:400:kworker.0 00000100:00100000:3.0:1786400843.000847:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786400843.000867:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd5bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872133760:0@lo:400:kworker.0 00000100:00100000:3.0:1786400843.000935:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400843.000980:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872133760 00000100:00100000:3.0:1786400843.000987:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872133760 00000100:00100000:3.0:1786400843.001042:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1786400843.001051:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd5b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872133760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400843.001114:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd5b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872133760:12345-0@lo:400:kworker.0 Request processed in 64us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400843.001121:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1786400843.001155:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ffd5bb100 x1873176872133760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400843.001168:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd5bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872133760:0@lo:400:kworker.0 00000100:00100000:3.0:1786400843.001208:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd5bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873176872133888:0@lo:400:kworker.0 00000100:00100000:3.0:1786400843.001296:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400843.001325:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872133888 00000100:00100000:3.0:1786400843.001329:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872133888 00000100:00100000:3.0:1786400843.001362:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1786400843.001368:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd5b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873176872133888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400843.001398:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd5b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873176872133888:12345-0@lo:400:kworker.0 Request processed in 31us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400843.001404:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1786400843.001418:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400843.001435:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd5bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873176872133888:0@lo:400:kworker.0 00000100:00100000:1.0:1786400843.001556:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4909c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872133248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8695us (10118us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400843.001565:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1786400843.005908:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fc4987480 x1873176872133248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400858 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400843.005935:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc4987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872133248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786400843.313023:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400843.314215:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850080640 00000100:00100000:2.0:1786400843.314227:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850080640 00000100:00100000:2.0:1786400843.314317:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 204 00000100:00100000:2.0:1786400843.314327:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:2365:x1873176850080640:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:2.0:1786400843.314403:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:2365:x1873176850080640:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 78us (1401us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400843.314411:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 204 00000100:00100000:0.0:1786400843.314592:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400843.314755:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850080768 00000100:00100000:1.0:1786400843.314760:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850080768 00000100:00100000:1.0:1786400843.314851:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 59 00000100:00100000:1.0:1786400843.314861:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+6:2365:x1873176850080768:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:1.0:1786400843.314915:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+6:2365:x1873176850080768:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 57us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400843.314922:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 59 00000100:00080000:3.0:1786400843.315593:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786400843.695492:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400844.718367:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400845.742599:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400846.771663:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1786400847.140737:0:9980:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 18:27:24 (1786400844) === 00000100:00100000:0.0:1786400847.563014:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400847.563185:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850080896 00000100:00100000:2.0:1786400847.563195:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850080896 00000100:00100000:2.0:1786400847.563255:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 205 00000100:00100000:2.0:1786400847.563269:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:8118:x1873176850080896:12345-192.168.204.8@tcp:101:mount.lustre.0 00010000:00010000:2.0:1786400847.563288:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400847.563309:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fc4e5d800/0x5ccaaf4f3cb1d94f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6ba85 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400847.563338:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc4e5d800/0x5ccaaf4f3cb1d94f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba85 expref: 11 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400847.563349:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fc4e5d800/0x5ccaaf4f3cb1d94f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba85 expref: 11 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400847.563359:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc4e5d800, rc 0) 00000100:00100000:2.0:1786400847.563542:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+11:8118:x1873176850080896:12345-192.168.204.8@tcp:101:mount.lustre.0 Request processed in 276us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400847.563568:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 205 00000100:00100000:1.0:1786400847.573205:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400847.573319:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850081024 00000100:00100000:2.0:1786400847.573336:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850081024 00000100:00100000:2.0:1786400847.573419:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 206 00000100:00100000:2.0:1786400847.573431:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+11:8118:x1873176850081024:12345-192.168.204.8@tcp:501:mount.lustre.0 00000100:00100000:2.0:1786400847.575726:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+11:8118:x1873176850081024:12345-192.168.204.8@tcp:501:mount.lustre.0 Request processed in 2288us (2522us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400847.575741:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 206 00000100:00100000:3.0:1786400847.581467:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400847.581595:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850081152 00000100:00100000:2.0:1786400847.581609:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850081152 00000100:00100000:2.0:1786400847.581748:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 207 00000100:00100000:2.0:1786400847.581759:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+11:8118:x1873176850081152:12345-192.168.204.8@tcp:503:mount.lustre.0 00000100:00100000:2.0:1786400847.582009:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+11:8118:x1873176850081152:12345-192.168.204.8@tcp:503:mount.lustre.0 Request processed in 251us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400847.582019:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 207 00000100:00100000:0.0:1786400847.587623:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400847.587742:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850081280 00000100:00100000:2.0:1786400847.587754:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850081280 00000100:00100000:2.0:1786400847.587979:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 208 00000100:00100000:2.0:1786400847.587992:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+11:8122:x1873176850081280:12345-192.168.204.8@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786400847.588315:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+11:8122:x1873176850081280:12345-192.168.204.8@tcp:502:llog_process_th.0 Request processed in 325us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400847.588323:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 208 00000100:00100000:2.0:1786400847.600564:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd5bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872134016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786400847.600642:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400847.601569:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872134016 00000100:00100000:0.0:1786400847.601580:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872134016 00000100:00100000:0.0:1786400847.601647:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1786400847.601656:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4984a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872134016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786400847.601690:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1786400847.602003:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786400847.603738:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4984a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872134016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2074us (3087us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400847.603752:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1786400847.603843:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ffd5bb100 x1873176872134016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400863 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400847.603865:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd5bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872134016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786400847.619346:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400847.620001:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850081408 00000100:00100000:2.0:1786400847.620012:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850081408 00000100:00100000:2.0:1786400847.620078:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 209 00000100:00100000:2.0:1786400847.620882:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+11:8122:x1873176850081408:12345-192.168.204.8@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786400847.622679:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+11:8122:x1873176850081408:12345-192.168.204.8@tcp:502:llog_process_th.0 Request processed in 1801us (3331us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400847.622693:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 209 00000100:00100000:3.0:1786400847.634984:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400847.636166:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850081536 00000100:00100000:2.0:1786400847.636182:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850081536 00000100:00100000:2.0:1786400847.636259:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 210 00000100:00100000:2.0:1786400847.636271:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+11:8118:x1873176850081536:12345-192.168.204.8@tcp:101:mount.lustre.0 00010000:00010000:2.0:1786400847.636288:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400847.636305:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fc4e5c200/0x5ccaaf4f3cb1d956 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6baaf expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400847.636334:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc4e5c200/0x5ccaaf4f3cb1d956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6baaf expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400847.636346:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fc4e5c200/0x5ccaaf4f3cb1d956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6baaf expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400847.636357:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc4e5c200, rc 0) 00000100:00100000:2.0:1786400847.636417:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+12:8118:x1873176850081536:12345-192.168.204.8@tcp:101:mount.lustre.0 Request processed in 148us (1450us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400847.636440:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 210 00000100:00100000:0.0:1786400847.662470:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400847.662629:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850081664 00000100:00100000:2.0:1786400847.662642:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850081664 00000100:00100000:2.0:1786400847.662826:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 211 00000100:00100000:2.0:1786400847.662839:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+12:8118:x1873176850081664:12345-192.168.204.8@tcp:256:mount.lustre.0 20000000:01000000:2.0:1786400847.662875:0:5780:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1786400847.662907:0:5780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1786400847.662912:0:5780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1786400847.662916:0:5780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1786400847.662918:0:5780:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1786400847.667717:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+12:8118:x1873176850081664:12345-192.168.204.8@tcp:256:mount.lustre.0 Request processed in 4864us (5747us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400847.667737:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 211 00000100:00100000:1.0:1786400847.671541:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400847.671841:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850081792 00000100:00100000:2.0:1786400847.671856:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850081792 00000100:00100000:2.0:1786400847.672236:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 212 00000100:00100000:2.0:1786400847.672252:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+12:8118:x1873176850081792:12345-192.168.204.8@tcp:101:mount.lustre.0 00010000:00010000:2.0:1786400847.672397:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400847.672597:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1d95d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bab6 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400847.672644:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1d95d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bab6 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400847.672658:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1d95d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bab6 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400847.672694:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc4e5cc00, rc 0) 00000100:00100000:2.0:1786400847.672864:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:8118:x1873176850081792:12345-192.168.204.8@tcp:101:mount.lustre.0 Request processed in 616us (1339us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400847.672873:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 212 00000100:00100000:0.0:1786400847.679514:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400847.679933:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850081920 00000100:00100000:2.0:1786400847.679947:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850081920 00000100:00100000:2.0:1786400847.680236:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 213 00000100:00100000:2.0:1786400847.680250:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:8118:x1873176850081920:12345-192.168.204.8@tcp:501:mount.lustre.0 00000100:00100000:2.0:1786400847.680765:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:8118:x1873176850081920:12345-192.168.204.8@tcp:501:mount.lustre.0 Request processed in 507us (1256us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400847.680779:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 213 00000100:00100000:0.0:1786400847.683690:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400847.683862:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850082048 00000100:00100000:2.0:1786400847.683876:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850082048 00000100:00100000:2.0:1786400847.684025:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 214 00000100:00100000:2.0:1786400847.684038:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:8118:x1873176850082048:12345-192.168.204.8@tcp:503:mount.lustre.0 00000100:00100000:2.0:1786400847.684585:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:8118:x1873176850082048:12345-192.168.204.8@tcp:503:mount.lustre.0 Request processed in 548us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400847.684596:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 214 00000100:00100000:1.0:1786400847.690577:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400847.690993:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850082176 00000100:00100000:2.0:1786400847.691183:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850082176 00000100:00100000:2.0:1786400847.691478:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 215 00000100:00100000:2.0:1786400847.691492:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:8125:x1873176850082176:12345-192.168.204.8@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786400847.692120:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:8125:x1873176850082176:12345-192.168.204.8@tcp:502:llog_process_th.0 Request processed in 629us (1703us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400847.692139:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 215 00000100:00100000:1.0:1786400847.697813:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400847.698043:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850082304 00000100:00100000:2.0:1786400847.698057:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850082304 00000100:00100000:0.0:1786400847.698514:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 216 00000100:00100000:0.0:1786400847.698530:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:8125:x1873176850082304:12345-192.168.204.8@tcp:502:llog_process_th.0 00000100:00100000:0.0:1786400847.698897:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:8125:x1873176850082304:12345-192.168.204.8@tcp:502:llog_process_th.0 Request processed in 370us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400847.698908:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 216 00000100:00100000:1.0:1786400847.704883:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400847.705661:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850082560 00000100:00100000:3.0:1786400847.705677:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850082560 00000100:00100000:1.0:1786400847.705686:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400847.706182:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850082432 00000100:00100000:2.0:1786400847.706189:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850082432 00000100:00100000:2.0:1786400847.706441:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 10 00000100:00100000:2.0:1786400847.706452:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff69b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2361:x1873176850082432:12345-192.168.204.8@tcp:38:mount.lustre.0 00010000:00080000:2.0:1786400847.706493:0:5789:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from fa744aa8-4d1c-4b23-b1b9-d5765b6f6856@192.168.204.8@tcp t0 exp 0000000000000000 cur 300 last 0 00000020:00000080:2.0:1786400847.706539:0:5789:0:(genops.c:1406:class_connect()) connect: client fa744aa8-4d1c-4b23-b1b9-d5765b6f6856, cookie 0x5ccaaf4f3cb1d964 00000004:00100000:2.0:1786400847.706581:0:5789:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1786400847.706968:0:5789:0:(import.c:65:import_set_state_nolock()) ffff9d6ff5fcd800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786400847.707138:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff69b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+6:2361:x1873176850082432:12345-192.168.204.8@tcp:38:mount.lustre.0 Request processed in 685us (1453us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400847.707148:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 10 00000100:00100000:2.0:1786400847.708397:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 60 00000100:00100000:2.0:1786400847.708417:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff69b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+6:2365:x1873176850082560:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:2.0:1786400847.708501:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff69b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+6:2365:x1873176850082560:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 92us (3634us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400847.708839:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 60 00000100:00080000:1.0:1786400847.711559:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400847.716244:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400847.716401:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850082816 00000100:00100000:2.0:1786400847.716414:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850082816 00000100:00100000:2.0:1786400847.716582:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 11 00000100:00100000:2.0:1786400847.716596:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff69b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+6:8118:x1873176850082816:12345-192.168.204.8@tcp:41:mount.lustre.0 00000004:00000024:2.0:1786400847.716658:0:5790:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1786400847.716919:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff69b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+6:8118:x1873176850082816:12345-192.168.204.8@tcp:41:mount.lustre.0 Request processed in 317us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400847.716953:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 11 00000100:00100000:1.0:1786400847.717009:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400847.717133:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850082688 00000100:00100000:0.0:1786400847.717139:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850082688 00000100:00100000:0.0:1786400847.717188:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 12 00000100:00100000:0.0:1786400847.717201:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff69b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+6:0:x1873176850082688:12345-192.168.204.8@tcp:41:mount.lustre.0 00000004:00000024:0.0:1786400847.717219:0:5789:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1786400847.718137:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff69b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+6:0:x1873176850082688:12345-192.168.204.8@tcp:41:mount.lustre.0 Request processed in 933us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400847.718147:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 12 00000100:00080000:3.0:1786400847.718940:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400847.721820:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400847.721913:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850082944 00000100:00100000:2.0:1786400847.722132:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850082944 00000100:00100000:2.0:1786400847.722213:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 13 00000100:00100000:2.0:1786400847.722224:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+6:8118:x1873176850082944:12345-192.168.204.8@tcp:40:mount.lustre.0 00000100:00100000:2.0:1786400847.723579:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+6:8118:x1873176850082944:12345-192.168.204.8@tcp:40:mount.lustre.0 Request processed in 1346us (1761us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400847.723596:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 13 00000100:00100000:1.0:1786400847.732572:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400847.732624:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400847.732945:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850083072 00000100:00100000:3.0:1786400847.732959:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850083072 00000100:00100000:2.0:1786400847.733550:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400847.733628:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850083200 00000100:00100000:1.0:1786400847.733635:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850083200 00000100:00100000:0.0:1786400847.733655:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 12 00000100:00100000:0.0:1786400847.733667:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff69b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2361:x1873176850083072:12345-192.168.204.8@tcp:8:mount.lustre.0 00010000:00080000:0.0:1786400847.733716:0:6592:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from fa744aa8-4d1c-4b23-b1b9-d5765b6f6856@192.168.204.8@tcp t0 exp 0000000000000000 cur 300 last 0 00000100:00100000:1.0:1786400847.733825:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850083328 00000100:00100000:1.0:1786400847.733830:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850083328 00000100:00100000:1.0:1786400847.733874:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1 00000100:00100000:1.0:1786400847.733883:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+6:8118:x1873176850083328:12345-192.168.204.8@tcp:33:mount.lustre.0 00000020:00000080:0.0:1786400847.734109:0:6592:0:(genops.c:1406:class_connect()) connect: client fa744aa8-4d1c-4b23-b1b9-d5765b6f6856, cookie 0x5ccaaf4f3cb1d96b 00002000:00100000:0.0:1786400847.734145:0:6592:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fa744aa8-4d1c-4b23-b1b9-d5765b6f6856/ffff9d6ffd559800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1786400847.734161:0:6592:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000004:00200000:1.0:1786400847.734328:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00002000:00080000:0.0:1786400847.735663:0:6592:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1786400847.735720:0:6592:0:(import.c:65:import_set_state_nolock()) ffff9d6ffd55d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786400847.736210:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff69b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+6:2361:x1873176850083072:12345-192.168.204.8@tcp:8:mount.lustre.0 Request processed in 2539us (3649us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400847.736223:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 12 00000100:00100000:0.0:1786400847.736779:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 13 00000100:00100000:0.0:1786400847.736792:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff69b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2361:x1873176850083200:12345-192.168.204.8@tcp:8:mount.lustre.0 00010000:00080000:0.0:1786400847.736830:0:6592:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from fa744aa8-4d1c-4b23-b1b9-d5765b6f6856@192.168.204.8@tcp t0 exp 0000000000000000 cur 300 last 0 00000020:00000080:0.0:1786400847.736868:0:6592:0:(genops.c:1406:class_connect()) connect: client fa744aa8-4d1c-4b23-b1b9-d5765b6f6856, cookie 0x5ccaaf4f3cb1d972 00002000:00100000:0.0:1786400847.736883:0:6592:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fa744aa8-4d1c-4b23-b1b9-d5765b6f6856/ffff9d6ffd558000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1786400847.736911:0:6592:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1786400847.738814:0:6592:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1786400847.738870:0:6592:0:(import.c:65:import_set_state_nolock()) ffff9d6ffd55b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786400847.738989:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff69b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+6:2361:x1873176850083200:12345-192.168.204.8@tcp:8:mount.lustre.0 Request processed in 2196us (6361us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400847.739250:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 13 00000100:00100000:1.0:1786400847.740652:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+6:8118:x1873176850083328:12345-192.168.204.8@tcp:33:mount.lustre.0 Request processed in 6759us (7093us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400847.740668:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1 00010000:00010000:0.0:1786400847.790497:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400848.111424:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786400848.111457:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc4987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872134144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786400848.111552:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400848.112354:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee1daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873176872134656:0@lo:400:kworker.0 00000100:00100000:3.0:1786400848.112407:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400848.112446:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786400848.112452:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee1d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872134272:0@lo:400:kworker.0 00000100:00100000:3.0:1786400848.112485:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400848.112523:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee1da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872134400:0@lo:400:kworker.0 00000100:00100000:3.0:1786400848.112550:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400848.112572:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786400848.112578:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee1d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872134528:0@lo:400:kworker.0 00000100:00100000:3.0:1786400848.112601:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400848.112805:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872134144 00000100:00100000:1.0:1786400848.112815:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872134144 00000100:00100000:1.0:1786400848.112890:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1786400848.112930:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872134144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786400848.112960:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400848.113009:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872134144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (1458us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400848.113017:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1786400848.113060:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872134656 00000100:00100000:1.0:1786400848.113064:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872134656 00000100:00100000:1.0:1786400848.113120:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872134400 00000100:00100000:1.0:1786400848.113123:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872134400 00000100:00100000:1.0:1786400848.113138:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872134528 00000100:00100000:1.0:1786400848.113140:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872134528 00000100:00100000:1.0:1786400848.113162:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1786400848.113169:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd5b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873176872134656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400848.113210:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd5b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873176872134656:12345-0@lo:400:kworker.0 Request processed in 41us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400848.113217:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1786400848.113228:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1786400848.113234:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd5b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872134400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400848.113265:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd5b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872134400:12345-0@lo:400:kworker.0 Request processed in 31us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400848.113271:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1786400848.113281:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1786400848.113288:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd5bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872134528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400848.113313:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd5bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872134528:12345-0@lo:400:kworker.0 Request processed in 27us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400848.113319:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1786400848.113371:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee1daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873176872134656:0@lo:400:kworker.0 00000100:00100000:1.0:1786400848.113431:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee1d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872134528:0@lo:400:kworker.0 00000100:00100000:1.0:1786400848.113450:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee1da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872134400:0@lo:400:kworker.0 00010000:00080000:2.0:1786400848.113581:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fc4987800 x1873176872134144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400864 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400848.113714:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc4987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872134144:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1786400848.113778:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786400848.113784:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786400848.113800:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872134272 00000100:00100000:2.0:1786400848.113806:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872134272 00000100:00100000:2.0:1786400848.113870:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1786400848.113880:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+19:3308:x1873176872134272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400848.113994:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+19:3308:x1873176872134272:12345-0@lo:400:kworker.0 Request processed in 115us (1506us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400848.114001:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1786400848.114043:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee1d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872134272:0@lo:400:kworker.0 00000001:00100000:2.0:1786400848.189548:0:6619:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fa744aa8-4d1c-4b23-b1b9-d5765b6f6856 00010000:00010000:0.0:1786400848.818653:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400849.838305:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400850.866889:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400851.886794:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1786400852.257289:0:7501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fa744aa8-4d1c-4b23-b1b9-d5765b6f6856 00000100:00100000:1.0:1786400852.719184:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff69b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872134784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786400852.719245:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400852.719311:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872134784 00000100:00100000:1.0:1786400852.719319:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872134784 00000100:00100000:1.0:1786400852.719364:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1786400852.719373:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff69b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872134784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786400852.719405:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400852.719443:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff69b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872134784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400852.719450:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1786400852.719467:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1786400852.719492:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff69b7800 x1873176872134784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400868 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400852.719509:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff69b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872134784:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1786400852.807589:0:5810:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fa744aa8-4d1c-4b23-b1b9-d5765b6f6856 00010000:00010000:0.0:1786400852.916547:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400853.054495:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400853.054537:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400853.054574:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400853.054601:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850083456 00000100:00100000:3.0:1786400853.054611:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850083456 00000100:00100000:3.0:1786400853.054661:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 218 00000100:00100000:3.0:1786400853.054673:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2362:x1873176850083456:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:3.0:1786400853.054743:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2362:x1873176850083456:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 72us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400853.054751:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 218 00000100:00100000:3.0:1786400853.054975:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400853.055127:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400853.055150:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850083584 00000100:00100000:3.0:1786400853.055154:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850083584 00000100:00100000:3.0:1786400853.055188:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850083712 00000100:00100000:3.0:1786400853.055191:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850083712 00000100:00100000:3.0:1786400853.055213:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 64 00000100:00100000:3.0:1786400853.055220:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd5b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+6:2362:x1873176850083584:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:3.0:1786400853.055255:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd5b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+6:2362:x1873176850083584:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 36us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400853.055262:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 64 00000100:00100000:3.0:1786400853.055273:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 65 00000100:00100000:3.0:1786400853.055278:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd5ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2362:x1873176850083712:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:3.0:1786400853.055374:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd5ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2362:x1873176850083712:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 94us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400853.055380:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 65 00000100:00100000:3.0:1786400853.055400:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850083840 00000100:00100000:3.0:1786400853.055404:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850083840 00000100:00100000:3.0:1786400853.055431:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850083968 00000100:00100000:3.0:1786400853.055434:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850083968 00000100:00100000:3.0:1786400853.055449:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 25 00000100:00100000:3.0:1786400853.055456:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd5b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2362:x1873176850083840:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:3.0:1786400853.055482:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd5b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2362:x1873176850083840:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 27us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400853.055488:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 25 00000100:00100000:3.0:1786400853.055499:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 26 00000100:00100000:3.0:1786400853.055505:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd5b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2362:x1873176850083968:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:3.0:1786400853.055539:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd5b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2362:x1873176850083968:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 33us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400853.055545:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 26 00000100:00080000:3.0:1786400853.055561:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786400853.055565:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786400853.055567:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1786400853.085773:0:10178:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg408-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:2.0:1786400853.230393:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786400853.230413:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc4987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872134912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786400853.230481:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400853.230666:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872134912 00000100:00100000:1.0:1786400853.230674:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872134912 00000100:00100000:1.0:1786400853.230736:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1786400853.230745:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4984e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872134912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786400853.230776:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400853.230828:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4984e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872134912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400853.230835:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1786400853.230889:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fc4987800 x1873176872134912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400869 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400853.230906:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc4987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872134912:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1786400853.231021:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786400853.232314:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee1d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873176872135168:0@lo:400:kworker.0 00000100:00100000:0.0:1786400853.232360:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400853.232386:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786400853.232391:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee1d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873176872135296:0@lo:400:kworker.0 00000100:00100000:0.0:1786400853.232411:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400853.232438:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872135168 00000100:00100000:0.0:1786400853.232443:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872135168 00000100:00100000:0.0:1786400853.232473:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872135296 00000100:00100000:0.0:1786400853.232476:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872135296 00000100:00100000:0.0:1786400853.232503:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1786400853.232510:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873176872135168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400853.232566:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873176872135168:12345-0@lo:400:kworker.0 Request processed in 56us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400853.232573:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1786400853.232586:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1786400853.232591:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873176872135296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400853.232612:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873176872135296:12345-0@lo:400:kworker.0 Request processed in 22us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400853.232617:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1786400853.232639:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee1dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873176872135424:0@lo:400:kworker.0 00000100:00100000:0.0:1786400853.232660:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400853.232674:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786400853.232679:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee1dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:97b0324f-e214-4822-8711-e150ddac2a7e:3306:1873176872135040:0@lo:400:kworker.0 00000100:00100000:0.0:1786400853.232701:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1786400853.232740:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400853.232775:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee1d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873176872135296:0@lo:400:kworker.0 00000100:00100000:0.0:1786400853.232785:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee1d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873176872135168:0@lo:400:kworker.0 00000100:00100000:0.0:1786400853.232809:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872135424 00000100:00100000:0.0:1786400853.232884:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872135424 00000100:00100000:0.0:1786400853.232914:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1786400853.232920:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873176872135424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400853.232952:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873176872135424:12345-0@lo:400:kworker.0 Request processed in 32us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400853.232958:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1786400853.232972:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400853.232987:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee1dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873176872135424:0@lo:400:kworker.0 00000100:00100000:1.0:1786400853.234166:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872135040 00000100:00100000:1.0:1786400853.234174:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872135040 00000100:00100000:1.0:1786400853.234209:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1786400853.234218:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+19:3306:x1873176872135040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400853.234267:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+19:3306:x1873176872135040:12345-0@lo:400:kworker.0 Request processed in 50us (1564us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400853.234274:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1786400853.234500:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee1dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:97b0324f-e214-4822-8711-e150ddac2a7e:3306:1873176872135040:0@lo:400:kworker.0 00010000:00010000:2.0:1786400853.935404:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400854.958441:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400855.983143:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400857.009267:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400857.842831:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc4984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872135552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786400857.843116:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400857.843278:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872135552 00000100:00100000:2.0:1786400857.843289:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872135552 00000100:00100000:2.0:1786400857.843364:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1786400857.843380:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4986680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872135552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786400857.843427:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400857.847487:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4986680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872135552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4099us (4400us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400857.847507:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1786400857.847559:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1786400857.851935:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fc4984000 x1873176872135552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400873 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400857.851990:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc4984000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872135552:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1786400858.039879:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400858.161752:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400858.161798:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400858.161995:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400858.162018:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400858.162043:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400858.162071:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850084608 00000100:00100000:3.0:1786400858.162080:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850084608 00000100:00100000:3.0:1786400858.162160:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850084480 00000100:00100000:3.0:1786400858.162164:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850084480 00000100:00100000:3.0:1786400858.162182:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 27 00000100:00100000:3.0:1786400858.162191:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd5bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2362:x1873176850084608:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:3.0:1786400858.162264:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd5bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2362:x1873176850084608:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 73us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400858.162272:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 27 00000100:00100000:3.0:1786400858.162289:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 28 00000100:00100000:3.0:1786400858.162296:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd5bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2362:x1873176850084480:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:3.0:1786400858.162322:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd5bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2362:x1873176850084480:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 26us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400858.162328:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 28 00000100:00100000:3.0:1786400858.162359:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850084352 00000100:00100000:3.0:1786400858.162363:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850084352 00000100:00100000:3.0:1786400858.162404:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850084224 00000100:00100000:3.0:1786400858.162407:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850084224 00000100:00100000:3.0:1786400858.162429:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 69 00000100:00100000:3.0:1786400858.162447:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd5baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2362:x1873176850084352:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:3.0:1786400858.162479:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd5baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2362:x1873176850084352:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 44us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400858.162485:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 69 00000100:00100000:3.0:1786400858.162496:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 70 00000100:00100000:3.0:1786400858.162502:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd5b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+6:2362:x1873176850084224:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:3.0:1786400858.162522:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd5b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+6:2362:x1873176850084224:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 21us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400858.162527:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 70 00000100:00080000:3.0:1786400858.162546:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786400858.162550:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786400858.162552:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786400858.163265:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850084096 00000100:00100000:0.0:1786400858.163272:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850084096 00000100:00100000:0.0:1786400858.163318:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 220 00000100:00100000:0.0:1786400858.163326:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2362:x1873176850084096:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786400858.163366:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2362:x1873176850084096:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 41us (1624us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400858.163580:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 220 00000100:00100000:3.0:1786400858.352834:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd5b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873176872135808:0@lo:400:kworker.0 00000100:00100000:3.0:1786400858.352911:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400858.352965:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1786400858.352972:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd5ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:97b0324f-e214-4822-8711-e150ddac2a7e:3309:1873176872135680:0@lo:400:kworker.0 00000100:00100000:3.0:1786400858.353003:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400858.353027:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd9f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872136192:0@lo:400:kworker.0 00000100:00100000:3.0:1786400858.353052:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400858.353078:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd5bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872135936:0@lo:400:kworker.0 00000100:00100000:3.0:1786400858.353130:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400858.353157:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786400858.353163:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd5b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873176872136064:0@lo:400:kworker.0 00000100:00100000:3.0:1786400858.353183:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400858.353212:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872135808 00000100:00100000:3.0:1786400858.353219:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872135808 00000100:00100000:3.0:1786400858.353257:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872135936 00000100:00100000:3.0:1786400858.353261:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872135936 00000100:00100000:3.0:1786400858.353281:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872136064 00000100:00100000:3.0:1786400858.353284:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872136064 00000100:00100000:3.0:1786400858.353301:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1786400858.353308:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873176872135808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400858.353359:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873176872135808:12345-0@lo:400:kworker.0 Request processed in 50us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400858.353366:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1786400858.353397:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1786400858.353402:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872135936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400858.353807:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1786400858.353815:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd9f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873176872136064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400858.353849:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd9f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873176872136064:12345-0@lo:400:kworker.0 Request processed in 36us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400858.353854:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1786400858.353878:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872136192 00000100:00100000:2.0:1786400858.353888:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872136192 00000100:00100000:2.0:1786400858.353917:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1786400858.353923:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872136192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400858.353954:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872136192:12345-0@lo:400:kworker.0 Request processed in 31us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400858.353960:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1786400858.353978:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872135680 00000100:00100000:2.0:1786400858.353981:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872135680 00000100:00100000:2.0:1786400858.354002:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1786400858.354009:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+19:3309:x1873176872135680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400858.354036:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+19:3309:x1873176872135680:12345-0@lo:400:kworker.0 Request processed in 27us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400858.354041:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00080000:2.0:1786400858.354072:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786400858.354076:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786400858.354119:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd5b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873176872136064:0@lo:400:kworker.0 00000100:00100000:2.0:1786400858.354131:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd5bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872135936:0@lo:400:kworker.0 00000100:00100000:2.0:1786400858.354157:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff69b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872136320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786400858.354181:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400858.354203:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd5ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:97b0324f-e214-4822-8711-e150ddac2a7e:3309:1873176872135680:0@lo:400:kworker.0 00010000:00080000:2.0:1786400858.354213:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ffd9f2680 x1873176872136192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400858.354223:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd9f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872136192:0@lo:400:kworker.0 00000100:00100000:2.0:1786400858.354232:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd5b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873176872135808:0@lo:400:kworker.0 00000100:00100000:2.0:1786400858.354264:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872136320 00000100:00100000:2.0:1786400858.354267:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872136320 00000100:00100000:2.0:1786400858.354291:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1786400858.354297:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4984000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872136320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786400858.354321:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400858.354354:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4984000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872136320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400858.354360:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1786400858.354596:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872135936:12345-0@lo:400:kworker.0 Request processed in 29us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400858.354682:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:2.0:1786400858.356689:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff69b7800 x1873176872136320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400874 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400858.356724:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff69b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872136320:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1786400859.056899:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400860.078342:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400861.103926:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400862.128483:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400862.960185:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff69b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872136448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786400862.960257:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400862.960284:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872136448 00000100:00100000:2.0:1786400862.960293:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872136448 00000100:00100000:2.0:1786400862.960363:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1786400862.960374:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872136448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786400862.960407:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400862.960942:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872136448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 499us (614us total) trans 0 rc 0/0 00010000:00080000:0.0:1786400862.960993:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff69b4000 x1873176872136448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400878 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400862.961032:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff69b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872136448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786400862.961479:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1786400862.961505:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786400863.150431:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400863.282791:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400863.282848:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400863.284095:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400863.284155:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400863.284192:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400863.284259:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850084864 00000100:00100000:3.0:1786400863.284273:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850084864 00000100:00100000:2.0:1786400863.284477:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850084992 00000100:00100000:0.0:1786400863.284484:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850084736 00000100:00100000:2.0:1786400863.284493:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850084992 00000100:00100000:0.0:1786400863.284493:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850084736 00000100:00100000:0.0:1786400863.284549:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 222 00000100:00100000:0.0:1786400863.284559:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2365:x1873176850084736:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786400863.284645:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2365:x1873176850084736:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 87us (1869us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400863.284653:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 222 00000100:00100000:2.0:1786400863.285968:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 74 00000100:00100000:2.0:1786400863.285984:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+6:2364:x1873176850084864:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:2.0:1786400863.286043:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+6:2364:x1873176850084864:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 64us (3195us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400863.286059:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 74 00000100:00100000:2.0:1786400863.286076:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 75 00000100:00100000:2.0:1786400863.286114:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd9f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2365:x1873176850084992:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:3.0:1786400863.286144:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850085120 00000100:00100000:2.0:1786400863.286154:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd9f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2365:x1873176850084992:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 65us (2071us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400863.286158:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850085120 00000100:00100000:2.0:1786400863.286165:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 75 00000100:00080000:2.0:1786400863.286217:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1786400863.286223:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786400863.286236:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850085248 00000100:00100000:2.0:1786400863.286242:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850085248 00000100:00100000:3.0:1786400863.286298:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 30 00000100:00100000:3.0:1786400863.286309:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd9f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2364:x1873176850085120:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:3.0:1786400863.286370:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd9f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2364:x1873176850085120:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 64us (2214us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400863.286378:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 30 00000100:00100000:2.0:1786400863.286503:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 31 00000100:00100000:2.0:1786400863.286518:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2365:x1873176850085248:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:2.0:1786400863.286644:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2365:x1873176850085248:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 131us (2449us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400863.286653:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 31 00000100:00080000:2.0:1786400863.286682:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786400863.474917:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd9f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873176872136960:0@lo:400:kworker.0 00000100:00100000:1.0:1786400863.475018:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400863.475286:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:97b0324f-e214-4822-8711-e150ddac2a7e:3307:1873176872136576:0@lo:400:kworker.0 00000100:00100000:1.0:1786400863.475326:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400863.475374:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd9f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872137088:0@lo:400:kworker.0 00000100:00100000:1.0:1786400863.475402:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400863.475577:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd9f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873176872136832:0@lo:400:kworker.0 00000100:00100000:2.0:1786400863.475626:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400863.475655:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786400863.475664:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd9f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873176872136704:0@lo:400:kworker.0 00000100:00100000:2.0:1786400863.475689:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400863.475725:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872136960 00000100:00100000:2.0:1786400863.475734:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872136960 00000100:00100000:2.0:1786400863.475805:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872136832 00000100:00100000:2.0:1786400863.475809:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872136832 00000100:00100000:2.0:1786400863.475827:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872136704 00000100:00100000:2.0:1786400863.475841:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872136704 00000100:00100000:2.0:1786400863.475863:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1786400863.475872:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff69b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873176872136960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400863.475934:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff69b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873176872136960:12345-0@lo:400:kworker.0 Request processed in 63us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400863.475942:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1786400863.475963:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1786400863.475969:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873176872136832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400863.476002:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873176872136832:12345-0@lo:400:kworker.0 Request processed in 34us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400863.476009:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1786400863.476020:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1786400863.476149:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872136576 00000100:00100000:1.0:1786400863.476155:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872136576 00000100:00100000:1.0:1786400863.476191:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1786400863.476199:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+19:3307:x1873176872136576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400863.476238:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+19:3307:x1873176872136576:12345-0@lo:400:kworker.0 Request processed in 40us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400863.476244:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1786400863.476279:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872137088 00000100:00100000:1.0:1786400863.476283:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872137088 00000100:00100000:1.0:1786400863.476325:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1786400863.476331:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff69b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872137088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400863.476363:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff69b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872137088:12345-0@lo:400:kworker.0 Request processed in 33us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400863.476370:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1786400863.476472:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd9f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873176872136960:0@lo:400:kworker.0 00000100:00100000:1.0:1786400863.476508:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:97b0324f-e214-4822-8711-e150ddac2a7e:3307:1873176872136576:0@lo:400:kworker.0 00010000:00080000:1.0:1786400863.476522:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ffd9f1500 x1873176872137088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400863.476534:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd9f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872137088:0@lo:400:kworker.0 00000100:00100000:1.0:1786400863.476722:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff69b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872137216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786400863.476799:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400863.476834:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872137216 00000100:00100000:1.0:1786400863.476839:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872137216 00000100:00100000:1.0:1786400863.476868:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1786400863.476876:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff69b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872137216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786400863.476910:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400863.476950:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff69b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872137216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400863.476957:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1786400863.476982:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff69b6a00 x1873176872137216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400879 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400863.476997:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff69b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872137216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786400863.477312:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4986a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873176872136704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400863.477359:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4986a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873176872136704:12345-0@lo:400:kworker.0 Request processed in 1333us (1668us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400863.477367:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1786400863.477397:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786400863.477403:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786400863.478164:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd9f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873176872136704:0@lo:400:kworker.0 00000100:00100000:2.0:1786400863.478191:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd9f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873176872136832:0@lo:400:kworker.0 00010000:00010000:3.0:1786400864.175373:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400865.199332:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400866.226618:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400867.252132:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400868.079620:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff69b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872137344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786400868.079727:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400868.079906:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872137344 00000100:00100000:3.0:1786400868.079921:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872137344 00000100:00080000:1.0:1786400868.080157:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786400868.080221:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1786400868.080235:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872137344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786400868.080284:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786400868.080374:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872137344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400868.080382:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1786400868.081755:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff69b6a00 x1873176872137344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400884 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400868.081787:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff69b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872137344:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786400868.271166:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400868.406539:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400868.406795:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850085376 00000100:00100000:2.0:1786400868.406808:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850085376 00000100:00100000:1.0:1786400868.407383:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 224 00000100:00100000:1.0:1786400868.407403:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2364:x1873176850085376:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:1.0:1786400868.407510:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2364:x1873176850085376:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 115us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400868.407537:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 224 00000100:00100000:3.0:1786400868.421054:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400868.421152:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400868.421199:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400868.421261:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400868.421299:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850085504 00000100:00100000:2.0:1786400868.421433:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850085760 00000100:00100000:2.0:1786400868.421443:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850085760 00000100:00100000:0.0:1786400868.421524:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850085504 00000100:00100000:0.0:1786400868.421751:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850085632 00000100:00100000:0.0:1786400868.421756:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850085632 00000100:00100000:0.0:1786400868.421785:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 79 00000100:00100000:0.0:1786400868.421797:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd9f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+6:2364:x1873176850085504:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786400868.421902:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd9f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+6:2364:x1873176850085504:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 107us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400868.421911:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 79 00000100:00100000:0.0:1786400868.421929:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 80 00000100:00100000:0.0:1786400868.421934:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2365:x1873176850085632:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786400868.421953:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2365:x1873176850085632:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 19us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400868.421959:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 80 00000100:00100000:2.0:1786400868.422258:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850085888 00000100:00100000:1.0:1786400868.422288:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14 00000100:00100000:1.0:1786400868.422302:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2361:x1873176850085760:12345-192.168.204.8@tcp:9:kworker.0 00000020:00000080:1.0:1786400868.422329:0:6593:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5ccaaf4f3cb1d96b 00000100:00080000:1.0:1786400868.422340:0:6593:0:(import.c:65:import_set_state_nolock()) ffff9d6ffd55d800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1786400868.422390:0:6593:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1786400868.422407:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850085888 00010000:00010000:2.0:1786400868.422471:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400868.425318:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+2:2361:x1873176850085760:12345-192.168.204.8@tcp:9:kworker.0 Request processed in 3001us (4099us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400868.425337:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14 00000100:00100000:1.0:1786400868.425382:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 15 00000100:00100000:1.0:1786400868.425398:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2361:x1873176850085888:12345-192.168.204.8@tcp:9:kworker.0 00000020:00000080:1.0:1786400868.425435:0:6593:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5ccaaf4f3cb1d972 00000100:00080000:1.0:1786400868.425468:0:6593:0:(import.c:65:import_set_state_nolock()) ffff9d6ffd55b800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1786400868.426314:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786400868.426323:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786400868.426327:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786400868.429274:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1786400868.431530:0:6593:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1786400868.432124:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+2:2361:x1873176850085888:12345-192.168.204.8@tcp:9:kworker.0 Request processed in 6722us (10852us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400868.432141:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 15 00000100:00100000:3.0:1786400868.590416:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc4986d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:97b0324f-e214-4822-8711-e150ddac2a7e:3307:1873176872137600:0@lo:400:kworker.0 00000100:00100000:2.0:1786400868.590463:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc4987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873176872137856:0@lo:400:kworker.0 00000100:00100000:2.0:1786400868.590544:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400868.590545:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400868.590638:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786400868.590642:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc4986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872138112:0@lo:400:kworker.0 00000100:00100000:2.0:1786400868.590650:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc4987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873176872137728:0@lo:400:kworker.0 00000100:00100000:2.0:1786400868.590680:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400868.590704:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400868.590724:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872137856 00000100:00100000:2.0:1786400868.590734:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872137856 00000100:00100000:0.0:1786400868.590739:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff69b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872137472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786400868.590753:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872137600 00000100:00100000:3.0:1786400868.590759:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872137600 00000100:00100000:0.0:1786400868.590784:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400868.590811:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872137728 00000100:00100000:0.0:1786400868.590812:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc4985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873176872137984:0@lo:400:kworker.0 00000100:00100000:2.0:1786400868.590817:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872137728 00000100:00100000:3.0:1786400868.590819:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1786400868.590832:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+19:3307:x1873176872137600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400868.590846:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400868.590895:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+19:3307:x1873176872137600:12345-0@lo:400:kworker.0 Request processed in 65us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400868.590904:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1786400868.590960:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc4986d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:97b0324f-e214-4822-8711-e150ddac2a7e:3307:1873176872137600:0@lo:400:kworker.0 00000100:00080000:3.0:1786400868.591007:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400868.591022:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872138112 00000100:00100000:3.0:1786400868.591026:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872138112 00000100:00100000:3.0:1786400868.591062:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1786400868.591068:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd9f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872138112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400868.591126:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd9f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872138112:12345-0@lo:400:kworker.0 Request processed in 58us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400868.591133:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1786400868.591148:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786400868.592251:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872137984 00000100:00100000:2.0:1786400868.592274:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872137984 00000100:00100000:0.0:1786400868.592731:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1786400868.592750:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873176872137856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400868.592846:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873176872137856:12345-0@lo:400:kworker.0 Request processed in 104us (2305us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400868.592854:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1786400868.592875:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1786400868.592885:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873176872137728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400868.592921:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873176872137728:12345-0@lo:400:kworker.0 Request processed in 38us (2241us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400868.593008:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1786400868.593050:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872137472 00000100:00100000:0.0:1786400868.593070:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872137472 00000100:00100000:0.0:1786400868.593151:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1786400868.593158:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872137472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786400868.593193:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:3.0:1786400868.593247:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fc4986300 x1873176872138112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400868.593264:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc4986300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872138112:0@lo:400:kworker.0 00000100:00100000:3.0:1786400868.593346:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1786400868.593354:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873176872137984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400868.594457:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872137472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1291us (3666us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400868.594471:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873176872137984:12345-0@lo:400:kworker.0 Request processed in 1115us (3623us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400868.594474:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1786400868.594501:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:0.0:1786400868.594552:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff69b4380 x1873176872137472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400884 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400868.594577:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff69b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872137472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786400868.594589:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc4985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873176872137984:0@lo:400:kworker.0 00000100:00080000:0.0:1786400868.594644:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400868.594762:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc4987800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873176872137728:0@lo:400:kworker.0 00000100:00100000:1.0:1786400868.594777:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc4987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873176872137856:0@lo:400:kworker.0 00000001:00100000:3.0:1786400868.681735:0:6619:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fa744aa8-4d1c-4b23-b1b9-d5765b6f6856 00000020:00000080:3.0:1786400868.681745:0:6619:0:(genops.c:906:class_export_put()) final put ffff9d6ffd559800/fa744aa8-4d1c-4b23-b1b9-d5765b6f6856 00000020:00000080:2.0:1786400868.682673:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ffd559800/fa744aa8-4d1c-4b23-b1b9-d5765b6f6856 for lustre-OST0000 00000020:00000080:2.0:1786400868.682738:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ffd55d800 for lustre-OST0000 00010000:00010000:2.0:1786400869.295984:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1786400870.009078:0:10880:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1786400870.321434:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400871.343343:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400872.369567:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1786400872.767954:0:7501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fa744aa8-4d1c-4b23-b1b9-d5765b6f6856 00000020:00000080:0.0:1786400872.767966:0:7501:0:(genops.c:906:class_export_put()) final put ffff9d6ffd558000/fa744aa8-4d1c-4b23-b1b9-d5765b6f6856 00000020:00000080:3.0:1786400872.769253:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ffd558000/fa744aa8-4d1c-4b23-b1b9-d5765b6f6856 for lustre-OST0001 00000020:00000080:3.0:1786400872.769325:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ffd55b800 for lustre-OST0001 00000100:00100000:1.0:1786400873.202234:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786400873.202277:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff69b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872138240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786400873.202364:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400873.202448:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872138240 00000100:00100000:1.0:1786400873.202458:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872138240 00000100:00100000:1.0:1786400873.202532:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1786400873.202543:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff69b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872138240:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1786400873.202573:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1786400873.202600:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400873.202660:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff69b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872138240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400873.202668:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1786400873.202710:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff69b4700 x1873176872138240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400873.202733:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff69b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872138240:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786400873.403622:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400873.526478:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400873.526539:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400873.526574:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400873.526613:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850086272 00000100:00100000:0.0:1786400873.526627:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850086272 00000100:00100000:3.0:1786400873.526658:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850086016 00000100:00100000:3.0:1786400873.526663:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850086016 00000100:00100000:0.0:1786400873.526698:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850086144 00000100:00100000:0.0:1786400873.526701:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850086144 00000100:00100000:3.0:1786400873.526704:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 226 00000100:00100000:3.0:1786400873.526714:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2363:x1873176850086016:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786400873.526722:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 84 00000100:00100000:0.0:1786400873.526728:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2363:x1873176850086272:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:3.0:1786400873.528486:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2363:x1873176850086016:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 1759us (2010us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400873.528919:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 226 00000100:00080000:1.0:1786400873.532382:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400873.532447:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 85 00000100:00100000:1.0:1786400873.534313:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+6:2363:x1873176850086144:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786400873.534941:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2363:x1873176850086272:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 8207us (8395us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400873.534975:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 84 00000100:00100000:1.0:1786400873.538782:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+6:2363:x1873176850086144:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 6303us (12187us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400873.538803:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 85 00000100:00100000:3.0:1786400873.711206:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd9f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872138752:0@lo:400:kworker.0 00000100:00100000:3.0:1786400873.711572:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400873.711649:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1786400873.711659:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd9f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872138368:0@lo:400:kworker.0 00000100:00100000:3.0:1786400873.711698:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400873.711727:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc9268a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873176872138880:0@lo:400:kworker.0 00000100:00100000:3.0:1786400873.711756:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400873.711789:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872138496:0@lo:400:kworker.0 00000100:00100000:3.0:1786400873.711816:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400873.711836:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc9269500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872139008:0@lo:400:kworker.0 00000100:00100000:3.0:1786400873.711871:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400873.711891:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786400873.711896:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd9f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872138624:0@lo:400:kworker.0 00000100:00100000:3.0:1786400873.711918:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400873.711954:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872138752 00000100:00100000:3.0:1786400873.711965:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872138752 00000100:00100000:3.0:1786400873.712021:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872139008 00000100:00100000:3.0:1786400873.712025:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872139008 00000100:00100000:3.0:1786400873.712057:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1786400873.712067:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc926b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872138752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400873.712159:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc926b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872138752:12345-0@lo:400:kworker.0 Request processed in 92us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400873.712168:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1786400873.712189:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1786400873.712197:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc926a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872139008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400873.713023:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786400873.713043:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc4987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872139136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786400873.713121:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400873.713174:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872139136 00000100:00100000:2.0:1786400873.713180:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872139136 00000100:00100000:2.0:1786400873.713226:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1786400873.713233:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4987800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1873176872139136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786400873.713274:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400873.713327:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4987800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1873176872139136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400873.713356:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1786400873.713428:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fc4987480 x1873176872139136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400873.713454:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc4987480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872139136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786400873.714678:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc926a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872139008:12345-0@lo:400:kworker.0 Request processed in 2474us (2797us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400873.714694:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1786400873.714746:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872138368 00000100:00100000:3.0:1786400873.714754:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872138368 00000100:00100000:3.0:1786400873.714806:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1786400873.714815:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+19:3308:x1873176872138368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400873.714874:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+19:3308:x1873176872138368:12345-0@lo:400:kworker.0 Request processed in 59us (3176us total) trans 0 rc 0/0 00010000:00080000:2.0:1786400873.714937:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fc9269500 x1873176872139008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400873.714954:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc9269500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872139008:0@lo:400:kworker.0 00000100:00100000:2.0:1786400873.715272:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872138880 00000100:00100000:2.0:1786400873.715279:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872138880 00000100:00100000:2.0:1786400873.715320:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872138496 00000100:00100000:2.0:1786400873.715323:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872138496 00000100:00100000:2.0:1786400873.715336:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872138624 00000100:00100000:2.0:1786400873.715339:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872138624 00000100:00100000:2.0:1786400873.715353:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1786400873.715359:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9268e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873176872138880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400873.715404:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9268e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873176872138880:12345-0@lo:400:kworker.0 Request processed in 45us (3648us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400873.715423:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1786400873.715438:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1786400873.715445:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872138496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400873.715481:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872138496:12345-0@lo:400:kworker.0 Request processed in 37us (3664us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400873.715500:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1786400873.715512:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1786400873.715518:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9269f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872138624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400873.715552:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9269f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872138624:12345-0@lo:400:kworker.0 Request processed in 35us (3633us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400873.715558:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1786400873.715600:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd9f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872138624:0@lo:400:kworker.0 00000100:00100000:2.0:1786400873.715611:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872138496:0@lo:400:kworker.0 00000100:00080000:2.0:1786400873.718548:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786400873.718563:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786400873.719094:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1786400873.719831:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd9f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872138368:0@lo:400:kworker.0 00000100:00100000:3.0:1786400873.719876:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc9268a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873176872138880:0@lo:400:kworker.0 00010000:00080000:3.0:1786400873.719895:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ffd9f2680 x1873176872138752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400889 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400873.719909:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd9f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872138752:0@lo:400:kworker.0 00000020:00000080:2.0:1786400874.125439:0:11030:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007fff0c9a3810 00000020:00000080:2.0:1786400874.125462:0:11030:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:2.0:1786400874.125468:0:11030:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:2.0:1786400874.125478:0:11030:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff0c9a5aa0 20000000:00000080:2.0:1786400874.125488:0:11030:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d6ffd9fc400 uarg=0000000000000000 20000000:01000000:2.0:1786400874.125539:0:11030:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1786400874.125546:0:11030:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1786400874.125552:0:11030:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1786400874.126695:0:11031:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1786400874.126896:0:11030:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1786400874.132445:0:11030:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1786400874.132485:0:11030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d6fc4e5ce00/0x5ccaaf4f3cb1d979 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400874.132513:0:11030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1d91e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba7e expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400874.132524:0:11030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fc4e5c800/0x5ccaaf4f3cb1d92c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d925 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400874.132531:0:11030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d93a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d933 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400874.132556:0:11030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1d948 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d941 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400874.132564:0:11030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1d95d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bab6 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400874.132573:0:11030:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d6fc4e5ce00/0x5ccaaf4f3cb1d979 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400874.132630:0:11030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1d95d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bab6 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400874.132650:0:11030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1d95d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bab6 expref: 12 pid: 5783 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400874.132669:0:11030:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc4987480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11030:1873176872139264:192.168.204.8@tcp:104: 00010000:00010000:2.0:1786400874.132872:0:11030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1d948 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d941 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400874.132882:0:11030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1d948 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d941 expref: 18 pid: 5780 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400874.132893:0:11030:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc4985880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11030:1873176872139392:0@lo:104: 00000100:00100000:2.0:1786400874.132945:0:11030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786400874.132994:0:11030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d93a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d933 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400874.133002:0:11030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d93a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d933 expref: 18 pid: 5780 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400874.133019:0:11030:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc4986d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11030:1873176872139520:0@lo:104: 00000100:00100000:2.0:1786400874.133042:0:11030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786400874.133072:0:11030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fc4e5c800/0x5ccaaf4f3cb1d92c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d925 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400874.133080:0:11030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fc4e5c800/0x5ccaaf4f3cb1d92c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d925 expref: 18 pid: 5780 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400874.133133:0:11030:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd9f1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11030:1873176872139648:0@lo:104: 00000100:00100000:2.0:1786400874.133156:0:11030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786400874.133187:0:11030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1d91e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba7e expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400874.133196:0:11030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1d91e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba7e expref: 12 pid: 5781 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400874.133205:0:11030:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd9f0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11030:1873176872139776:192.168.204.8@tcp:104: 00000100:00100000:2.0:1786400874.133232:0:11030:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffd5b1300 going to sleep for 11 seconds 00000100:00100000:0.0:1786400874.133328:0:8368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872139392 00000100:00100000:0.0:1786400874.133339:0:8368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872139392 00000100:00100000:3.0:1786400874.133374:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872139520 00000100:00100000:3.0:1786400874.133380:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872139520 00000100:00100000:3.0:1786400874.133441:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872139648 00000100:00100000:3.0:1786400874.133444:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872139648 00000100:00100000:3.0:1786400874.133462:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1786400874.133472:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:97b0324f-e214-4822-8711-e150ddac2a7e+5:11030:x1873176872139520:12345-0@lo:104: 00010000:00010000:3.0:1786400874.133487:0:5772:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f800/0x5ccaaf4f3cb1d933 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d93a expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400874.133498:0:8368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1786400874.133508:0:8368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:97b0324f-e214-4822-8711-e150ddac2a7e+5:11030:x1873176872139648:12345-0@lo:104: 00010000:00010000:0.0:1786400874.133518:0:8368:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1d925 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d92c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400874.133570:0:5772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786400874.133578:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:97b0324f-e214-4822-8711-e150ddac2a7e+5:11030:x1873176872139520:12345-0@lo:104: Request processed in 107us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400874.133585:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1786400874.133606:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1786400874.133613:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4986300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:97b0324f-e214-4822-8711-e150ddac2a7e+4:11030:x1873176872139392:12345-0@lo:104: 00010000:00010000:3.0:1786400874.133621:0:5772:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1d941 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d948 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400874.133651:0:8368:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1786400874.133659:0:8368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:97b0324f-e214-4822-8711-e150ddac2a7e+4:11030:x1873176872139648:12345-0@lo:104: Request processed in 153us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400874.133667:0:8368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1786400874.133689:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786400874.133697:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f800/0x5ccaaf4f3cb1d933 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d93a expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400874.133705:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138f800 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:0.0:1786400874.133711:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f800/0x5ccaaf4f3cb1d933 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5ccaaf4f3cb1d93a expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400874.133722:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f800/0x5ccaaf4f3cb1d933 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5ccaaf4f3cb1d93a expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786400874.133731:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f800/0x5ccaaf4f3cb1d933 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5ccaaf4f3cb1d93a expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786400874.133737:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1786400874.133778:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f800/0x5ccaaf4f3cb1d933 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d93a expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400874.133792:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786400874.133821:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f800/0x5ccaaf4f3cb1d933 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d93a expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400874.133824:0:5772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1786400874.133832:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f800/0x5ccaaf4f3cb1d933 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d93a expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400874.133835:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4986300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:97b0324f-e214-4822-8711-e150ddac2a7e+3:11030:x1873176872139392:12345-0@lo:104: Request processed in 221us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400874.133851:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1786400874.133859:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786400874.133864:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1d925 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d92c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400874.133871:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5ab200 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:0.0:1786400874.133875:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1d925 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5ccaaf4f3cb1d92c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400874.133882:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1d925 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5ccaaf4f3cb1d92c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786400874.133889:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1d925 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5ccaaf4f3cb1d92c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786400874.133895:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1786400874.133910:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1d925 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d92c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400874.133917:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786400874.133923:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1d925 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d92c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400874.133930:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1d925 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d92c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400874.133949:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786400874.133952:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1d941 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d948 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400874.133958:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aa400 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:0.0:1786400874.133960:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1d941 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5ccaaf4f3cb1d948 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400874.133968:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1d941 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5ccaaf4f3cb1d948 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786400874.133974:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1d941 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5ccaaf4f3cb1d948 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786400874.133981:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1786400874.133995:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1d941 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d948 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400874.134001:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786400874.134021:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1d941 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d948 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400874.134043:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1d941 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d948 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400874.134058:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400874.134060:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400874.134061:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400874.134075:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee1d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:97b0324f-e214-4822-8711-e150ddac2a7e:3309:1873176872140032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786400874.134136:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400874.134159:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1786400874.134165:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee1d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:97b0324f-e214-4822-8711-e150ddac2a7e:3309:1873176872139904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786400874.134183:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400874.134212:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee1d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:97b0324f-e214-4822-8711-e150ddac2a7e:3306:1873176872140160:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786400874.134223:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400874.134236:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400874.134277:0:8369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872140032 00000100:00100000:3.0:1786400874.134281:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872139904 00000100:00100000:0.0:1786400874.134282:0:8369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872140032 00000100:00100000:3.0:1786400874.134287:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872139904 00010000:00010000:0.0:1786400874.134309:0:8369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fc4e5c800/0x5ccaaf4f3cb1d92c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d925 expref: 20 pid: 5780 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400874.134310:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d93a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d933 expref: 20 pid: 5780 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400874.134414:0:11030:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc4986d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11030:1873176872139520:0@lo:104: 00000100:00100000:0.0:1786400874.134423:0:8369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872140160 00000100:00100000:0.0:1786400874.134429:0:8369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872140160 00000100:00100000:2.0:1786400874.134432:0:11030:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd9f1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11030:1873176872139648:0@lo:104: 00000100:00100000:2.0:1786400874.134444:0:11030:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc4985880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11030:1873176872139392:0@lo:104: 00010000:00010000:0.0:1786400874.134510:0:8369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1d948 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d941 expref: 21 pid: 5780 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400874.134815:0:8369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1786400874.134824:0:8369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4588450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:97b0324f-e214-4822-8711-e150ddac2a7e+21:3309:x1873176872140032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786400874.134838:0:8369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400874.134845:0:8369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fc4e5c800/0x5ccaaf4f3cb1d92c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d925 expref: 21 pid: 5780 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400874.134858:0:8369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fc4e5c800/0x5ccaaf4f3cb1d92c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d925 expref: 21 pid: 5780 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400874.134875:0:8369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc4e5c800/0x5ccaaf4f3cb1d92c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d925 expref: 21 pid: 5780 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400874.134891:0:8369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400874.134918:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1786400874.134929:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:97b0324f-e214-4822-8711-e150ddac2a7e+20:3309:x1873176872139904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786400874.134938:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400874.134943:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d93a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d933 expref: 20 pid: 5780 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400874.134952:0:8369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4588450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:97b0324f-e214-4822-8711-e150ddac2a7e+20:3309:x1873176872140032:12345-0@lo:103:ldlm_bl.0 Request processed in 127us (813us total) trans 0 rc 0/0 00010000:00010000:3.0:1786400874.134956:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d93a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d933 expref: 20 pid: 5780 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400874.134966:0:8369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1786400874.134973:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d93a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d933 expref: 20 pid: 5780 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400874.134984:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400874.135017:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:97b0324f-e214-4822-8711-e150ddac2a7e+18:3309:x1873176872139904:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400874.135025:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1786400874.135032:0:8369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1786400874.135041:0:8369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:97b0324f-e214-4822-8711-e150ddac2a7e+17:3306:x1873176872140160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786400874.135049:0:8369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400874.135055:0:8369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1d948 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d941 expref: 17 pid: 5780 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400874.135063:0:8369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1d948 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d941 expref: 17 pid: 5780 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400874.135073:0:8369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1d948 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d941 expref: 17 pid: 5780 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400874.135081:0:8369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400874.135136:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee1d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:97b0324f-e214-4822-8711-e150ddac2a7e:3309:1873176872139904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786400874.135993:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee1d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:97b0324f-e214-4822-8711-e150ddac2a7e:3309:1873176872140032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786400874.136383:0:8369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:97b0324f-e214-4822-8711-e150ddac2a7e+16:3306:x1873176872140160:12345-0@lo:103:ldlm_bl.0 Request processed in 1340us (2143us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400874.136395:0:8369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1786400874.136986:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee1d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:97b0324f-e214-4822-8711-e150ddac2a7e:3306:1873176872140160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786400874.139032:0:11030:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc4987480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11030:1873176872139264:192.168.204.8@tcp:104: 00000100:00100000:0.0:1786400874.139051:0:11030:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd9f0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11030:1873176872139776:192.168.204.8@tcp:104: 00010000:00010000:0.0:1786400874.139508:0:11030:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d6fc4e5ce00/0x5ccaaf4f3cb1d979 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400874.141064:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400874.141217:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400874.141548:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850086400 00000100:00100000:1.0:1786400874.141561:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850086400 00010000:00010000:1.0:1786400874.141612:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1d95d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bab6 expref: 13 pid: 5783 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400874.141654:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850086528 00000100:00100000:1.0:1786400874.141658:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850086528 00010000:00010000:1.0:1786400874.141671:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1d91e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba7e expref: 14 pid: 5781 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400874.142164:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 28 00000100:00100000:1.0:1786400874.142201:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9268a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+14:2365:x1873176850086400:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400874.142222:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400874.142230:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1d95d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bab6 expref: 14 pid: 5783 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400874.142247:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1d95d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bab6 expref: 14 pid: 5783 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400874.142272:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1d95d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bab6 expref: 14 pid: 5783 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400874.142291:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400874.142364:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9268a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2365:x1873176850086400:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 167us (1310us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400874.142566:0:8369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 29 00000100:00100000:3.0:1786400874.142580:0:8369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc926aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2365:x1873176850086528:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786400874.142590:0:8369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400874.142596:0:8369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1d91e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba7e expref: 13 pid: 5781 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400874.142620:0:8369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1d91e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba7e expref: 13 pid: 5781 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400874.142633:0:8369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1d91e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba7e expref: 13 pid: 5781 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400874.142646:0:8369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d6fc4e5ce00/0x5ccaaf4f3cb1d979 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400874.142655:0:8369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc4e5ce00/0x5ccaaf4f3cb1d979 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400874.142676:0:8369:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fc4e5ce00/0x5ccaaf4f3cb1d979 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400874.142684:0:8369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fc4e5ce00/0x5ccaaf4f3cb1d979 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400874.142691:0:8369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d6fc4e5ce00/0x5ccaaf4f3cb1d979 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400874.142708:0:8369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d6fc4e5ce00/0x5ccaaf4f3cb1d979 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400874.142715:0:8369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5ce00 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:3.0:1786400874.142720:0:8369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d6fc4e5ce00/0x5ccaaf4f3cb1d979 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400874.142730:0:8369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d6fc4e5ce00/0x5ccaaf4f3cb1d979 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400874.142762:0:8369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d6fc4e5ce00/0x5ccaaf4f3cb1d979 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400874.142774:0:8369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400874.142800:0:8369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc926aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6ee3c8da-45b0-4b79-a1d4-46386550e92b+12:2365:x1873176850086528:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 225us (1583us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400874.142808:0:8369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 29 00010000:00010000:0.0:1786400874.143295:0:11030:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d6fc4e5ce00/0x5ccaaf4f3cb1d979 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400874.143307:0:11030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d6fc4e5ce00/0x5ccaaf4f3cb1d979 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400874.143326:0:11030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc4e5ce00/0x5ccaaf4f3cb1d979 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400874.145200:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 28 00010000:00010000:0.0:1786400874.414443:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400875.438938:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1786400876.017652:0:5785:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1786400876.017660:0:5785:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6ec470a000 from 7 10000000:01000000:2.0:1786400876.017665:0:5785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1786400876.017712:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1d980 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400876.017725:0:5785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1d980 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400876.017736:0:5785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1d980 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400876.017761:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd9f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872140288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786400876.017826:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400876.017876:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffd5b1540 going to sleep for 11 seconds 00000100:00100000:3.0:1786400876.017928:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872140288 00000100:00100000:3.0:1786400876.017936:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872140288 00000100:00100000:3.0:1786400876.017992:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1786400876.018000:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+16:5785:x1873176872140288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786400876.018015:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400876.018028:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1d987 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d980 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400876.018050:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1d987 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d980 expref: 17 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400876.018061:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1d987 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d980 expref: 17 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400876.018071:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7d38e00, rc 0) 00000100:00100000:3.0:1786400876.018136:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+17:5785:x1873176872140288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400876.018144:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1786400876.018233:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd9f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872140288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786400876.018247:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1d980 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d987 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400876.018256:0:5785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1d980 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d987 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400876.018310:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd9f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872140416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786400876.018335:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400876.018355:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffd5b1540 going to sleep for 11 seconds 00000100:00100000:3.0:1786400876.018412:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872140416 00000100:00100000:3.0:1786400876.018416:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872140416 00000100:00100000:3.0:1786400876.018455:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1786400876.018462:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+17:5785:x1873176872140416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786400876.018706:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+17:5785:x1873176872140416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 244us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400876.018713:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1786400876.021720:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd9f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872140416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786400876.021775:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd9f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872140544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786400876.021853:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400876.021889:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffd5b1540 going to sleep for 11 seconds 00000100:00100000:2.0:1786400876.021910:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872140544 00000100:00100000:2.0:1786400876.021916:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872140544 00000100:00100000:2.0:1786400876.021980:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1786400876.021989:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+17:5785:x1873176872140544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786400876.022191:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+17:5785:x1873176872140544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 203us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400876.022199:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1786400876.022244:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd9f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872140544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1786400876.023914:0:11098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1786400876.024081:0:5785:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1786400876.024141:0:5785:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1786400876.024152:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1d980 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d987 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400876.024163:0:5785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1d980 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d987 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400876.024173:0:5785:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1786400876.024175:0:5785:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6fc49f0000 from 7 10000000:01000000:3.0:1786400876.024178:0:5785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1786400876.024213:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1d98e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400876.024221:0:5785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1d98e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400876.024231:0:5785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1d98e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400876.024255:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc926ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872140672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786400876.024311:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400876.024338:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc34d6600 going to sleep for 11 seconds 00000100:00100000:2.0:1786400876.024864:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872140672 00000100:00100000:2.0:1786400876.024873:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872140672 00000100:00100000:2.0:1786400876.024957:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1786400876.024967:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+17:5785:x1873176872140672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786400876.024980:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400876.024994:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1d995 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d98e expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400876.025016:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1d995 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d98e expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400876.025027:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1d995 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d98e expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400876.025035:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc4e5cc00, rc 0) 00000100:00100000:2.0:1786400876.025109:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+18:5785:x1873176872140672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400876.025121:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1786400876.025213:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc926ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872140672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786400876.025227:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1d98e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d995 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400876.025236:0:5785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1d98e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d995 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400876.025289:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff69b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872140800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786400876.025321:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400876.025429:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffccb7540 going to sleep for 11 seconds 00000100:00100000:3.0:1786400876.025470:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872140800 00000100:00100000:3.0:1786400876.025480:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872140800 00000100:00100000:3.0:1786400876.025501:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1786400876.025507:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+18:5785:x1873176872140800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786400876.025782:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+18:5785:x1873176872140800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 273us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400876.025789:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1786400876.025876:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff69b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872140800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786400876.025904:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff69b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872140928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786400876.025945:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400876.025995:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffccb7540 going to sleep for 11 seconds 00000100:00100000:2.0:1786400876.026175:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872140928 00000100:00100000:2.0:1786400876.026179:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872140928 00000100:00100000:0.0:1786400876.027129:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1786400876.027139:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+18:5785:x1873176872140928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786400876.027476:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+18:5785:x1873176872140928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 338us (1530us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400876.027483:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1786400876.027571:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff69b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872140928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1786400876.028555:0:11099:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1786400876.028680:0:5785:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1786400876.028701:0:5785:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1786400876.028711:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1d98e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d995 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400876.028723:0:5785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1d98e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d995 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400876.028733:0:5785:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1786400876.028736:0:5785:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6fc307d800 from 7 10000000:01000000:3.0:1786400876.028738:0:5785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1786400876.028770:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1d99c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400876.028777:0:5785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1d99c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400876.028786:0:5785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1d99c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400876.028806:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc9268380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872141056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786400876.028849:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400876.028881:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc34d6600 going to sleep for 11 seconds 00000100:00100000:3.0:1786400876.028895:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872141056 00000100:00100000:3.0:1786400876.028908:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872141056 00000100:00100000:3.0:1786400876.028944:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1786400876.028951:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+18:5785:x1873176872141056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786400876.028962:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400876.028973:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe7d39200/0x5ccaaf4f3cb1d9a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1d99c expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400876.028991:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe7d39200/0x5ccaaf4f3cb1d9a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d99c expref: 19 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400876.029001:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe7d39200/0x5ccaaf4f3cb1d9a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d99c expref: 19 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400876.029009:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7d39200, rc 0) 00000100:00100000:3.0:1786400876.029038:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+19:5785:x1873176872141056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400876.029045:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1786400876.029080:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc9268380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872141056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786400876.029109:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1d99c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d9a3 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400876.029118:0:5785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1d99c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d9a3 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400876.029156:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc9268380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872141184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786400876.029178:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400876.032197:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc34e9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1786400876.032446:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872141184 00000100:00100000:0.0:1786400876.032456:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872141184 00000100:00100000:0.0:1786400876.032514:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1786400876.032523:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+19:5785:x1873176872141184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786400876.032797:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+19:5785:x1873176872141184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 274us (3617us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400876.032805:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1786400876.032852:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc9268380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872141184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786400876.032899:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee1da680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872141312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786400876.032937:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400876.032964:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc924f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400876.033015:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872141312 00000100:00100000:2.0:1786400876.033020:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872141312 00000100:00100000:2.0:1786400876.033053:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1786400876.033060:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+19:5785:x1873176872141312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786400876.033216:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+19:5785:x1873176872141312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400876.033223:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1786400876.033326:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee1da680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872141312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1786400876.034158:0:11102:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1786400876.034391:0:5785:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1786400876.034416:0:5785:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1786400876.034427:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1d99c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d9a3 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400876.034439:0:5785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1d99c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d9a3 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400876.081724:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400876.081939:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850086656 00000100:00100000:0.0:1786400876.081951:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850086656 00000100:00100000:0.0:1786400876.082380:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 237 00000100:00100000:0.0:1786400876.082392:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+11:5580:x1873176850086656:12345-192.168.204.8@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786400876.082410:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400876.082427:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1d9aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bae0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400876.082456:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1d9aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bae0 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400876.082468:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1d9aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bae0 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400876.082478:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5ab800, rc 0) 00000100:00100000:0.0:1786400876.082544:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+12:5580:x1873176850086656:12345-192.168.204.8@tcp:101:ll_cfg_requeue.0 Request processed in 154us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400876.082551:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 237 00000100:00100000:2.0:1786400876.091873:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400876.093804:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850086784 00000100:00100000:0.0:1786400876.093817:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850086784 00000100:00100000:2.0:1786400876.099026:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 238 00000100:00100000:2.0:1786400876.099041:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+12:5580:x1873176850086784:12345-192.168.204.8@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786400876.099446:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+12:5580:x1873176850086784:12345-192.168.204.8@tcp:501:ll_cfg_requeue.0 Request processed in 407us (7581us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400876.099455:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 238 00000100:00100000:1.0:1786400876.107374:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400876.107486:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850086912 00000100:00100000:3.0:1786400876.107505:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850086912 00000100:00100000:3.0:1786400876.107874:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 239 00000100:00100000:3.0:1786400876.107886:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+12:5580:x1873176850086912:12345-192.168.204.8@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786400876.108125:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+12:5580:x1873176850086912:12345-192.168.204.8@tcp:503:ll_cfg_requeue.0 Request processed in 239us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400876.108134:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 239 00000100:00100000:0.0:1786400876.125445:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400876.125511:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850087040 00000100:00100000:3.0:1786400876.125521:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850087040 00000100:00100000:3.0:1786400876.125579:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 240 00000100:00100000:3.0:1786400876.125589:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+12:5580:x1873176850087040:12345-192.168.204.8@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786400876.125607:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400876.125725:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1d9b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bae7 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400876.125827:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1d9b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bae7 expref: 13 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400876.125840:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1d9b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bae7 expref: 13 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400876.125849:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7d38a00, rc 0) 00000100:00100000:3.0:1786400876.125910:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:5580:x1873176850087040:12345-192.168.204.8@tcp:101:ll_cfg_requeue.0 Request processed in 321us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400876.125918:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 240 00000100:00100000:3.0:1786400876.136224:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400876.136290:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850087168 00000100:00100000:2.0:1786400876.136307:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850087168 00000100:00100000:2.0:1786400876.136355:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 241 00000100:00100000:2.0:1786400876.136379:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:5580:x1873176850087168:12345-192.168.204.8@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786400876.137153:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:5580:x1873176850087168:12345-192.168.204.8@tcp:501:ll_cfg_requeue.0 Request processed in 786us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400876.137162:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 241 00000100:00100000:0.0:1786400876.145023:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400876.145864:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850087296 00000100:00100000:3.0:1786400876.145877:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850087296 00000100:00100000:3.0:1786400876.145940:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 242 00000100:00100000:3.0:1786400876.145961:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:5580:x1873176850087296:12345-192.168.204.8@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786400876.148003:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:5580:x1873176850087296:12345-192.168.204.8@tcp:503:ll_cfg_requeue.0 Request processed in 2035us (2979us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400876.148018:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 242 00010000:00010000:0.0:1786400876.465661:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400877.486346:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786400877.969857:0:11228:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg408-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1786400878.318659:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff69b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872141440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786400878.318939:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400878.319394:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872141440 00000100:00100000:0.0:1786400878.319402:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872141440 00000100:00100000:0.0:1786400878.319464:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1786400878.319474:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872141440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786400878.319508:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1786400878.319580:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786400878.319606:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872141440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400878.319626:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1786400878.324279:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff69b7480 x1873176872141440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400894 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400878.324337:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff69b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872141440:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786400878.510337:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400878.641944:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400878.642012:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400878.643658:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850087424 00000100:00100000:2.0:1786400878.643679:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850087424 00000100:00100000:2.0:1786400878.643775:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 243 00000100:00100000:2.0:1786400878.643788:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2362:x1873176850087424:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:2.0:1786400878.643913:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2362:x1873176850087424:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 128us (1985us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400878.643922:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 243 00000100:00100000:3.0:1786400878.644908:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850087680 00000100:00100000:3.0:1786400878.644921:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850087680 00000100:00100000:3.0:1786400878.644992:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 89 00000100:00080000:1.0:1786400878.644997:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400878.645009:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2362:x1873176850087680:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:3.0:1786400878.647168:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2362:x1873176850087680:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 2149us (5138us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400878.647186:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 89 00000100:00100000:0.0:1786400878.649834:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400878.650832:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850087552 00000100:00100000:2.0:1786400878.650849:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850087552 00000100:00100000:2.0:1786400878.651442:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 90 00000100:00100000:2.0:1786400878.651457:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+6:2362:x1873176850087552:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:2.0:1786400878.651904:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+6:2362:x1873176850087552:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 449us (2174us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400878.651914:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 90 00000100:00080000:1.0:1786400878.654011:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400878.830364:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc9268700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872141568:0@lo:400:kworker.0 00000100:00100000:3.0:1786400878.830368:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc926bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873176872141696:0@lo:400:kworker.0 00000100:00100000:3.0:1786400878.830442:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400878.830504:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400878.830510:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc926b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872142208:0@lo:400:kworker.0 00000100:00100000:3.0:1786400878.830553:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400878.830553:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc9269880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873176872142080:0@lo:400:kworker.0 00000100:00100000:0.0:1786400878.830652:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc926b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872141824:0@lo:400:kworker.0 00000100:00100000:3.0:1786400878.831025:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872141568 00000100:00100000:3.0:1786400878.831034:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872141568 00000100:00100000:2.0:1786400878.831177:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872142208 00000100:00100000:2.0:1786400878.831187:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872142208 00000100:00100000:2.0:1786400878.831263:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1786400878.831284:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400878.831286:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9269c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872142208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400878.831356:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872141696 00000100:00100000:1.0:1786400878.831363:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872141696 00000100:00100000:2.0:1786400878.831423:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9269c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872142208:12345-0@lo:400:kworker.0 Request processed in 148us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400878.831431:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1786400878.831463:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786400878.831491:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1786400878.831505:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+19:3308:x1873176872141568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400878.831547:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+19:3308:x1873176872141568:12345-0@lo:400:kworker.0 Request processed in 50us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400878.831554:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1786400878.831595:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872142080 00000100:00100000:2.0:1786400878.831601:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872142080 00010000:00080000:3.0:1786400878.831631:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fc926b100 x1873176872142208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400878.831650:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc926b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872142208:0@lo:400:kworker.0 00000100:00100000:2.0:1786400878.831661:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1786400878.831670:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff69b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873176872142080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400878.831713:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff69b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873176872142080:12345-0@lo:400:kworker.0 Request processed in 45us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400878.831719:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:3.0:1786400878.831768:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786400878.831773:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc9268700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872141568:0@lo:400:kworker.0 00000100:00100000:2.0:1786400878.831793:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc9269880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873176872142080:0@lo:400:kworker.0 00000100:00100000:3.0:1786400878.831825:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc926a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872141952:0@lo:400:kworker.0 00000100:00100000:3.0:1786400878.831872:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400878.831991:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872141952 00000100:00100000:2.0:1786400878.831997:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872141952 00000100:00100000:0.0:1786400878.832534:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400878.832574:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd9f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872142336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786400878.832612:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400878.832645:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1786400878.832664:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc926b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872141952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400878.832665:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872142336 00000100:00100000:0.0:1786400878.832673:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872142336 00000100:00100000:0.0:1786400878.832718:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1786400878.832729:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872142336:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786400878.832767:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc926b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872141952:12345-0@lo:400:kworker.0 Request processed in 109us (891us total) trans 0 rc 0/0 00002000:00000024:0.0:1786400878.832773:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400878.832779:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1786400878.832831:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872142336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400878.832839:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1786400878.832869:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872141824 00000100:00100000:0.0:1786400878.832874:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872141824 00000100:00100000:1.0:1786400878.832900:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1786400878.832917:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9269180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873176872141696:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1786400878.832935:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fc926a300 x1873176872141952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400878.832935:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1786400878.832957:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc926a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872141952:0@lo:400:kworker.0 00000100:00100000:1.0:1786400878.832980:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9269180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873176872141696:12345-0@lo:400:kworker.0 Request processed in 69us (2537us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400878.832988:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1786400878.833003:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc926bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873176872141696:0@lo:400:kworker.0 00000100:00080000:3.0:1786400878.833051:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1786400878.833056:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ffd9f1500 x1873176872142336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400894 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400878.833074:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd9f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872142336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786400878.834519:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872141824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400878.834633:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872141824:12345-0@lo:400:kworker.0 Request processed in 1683us (2100us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400878.834645:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1786400878.834719:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc926b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872141824:0@lo:400:kworker.0 00010000:00010000:3.0:1786400879.536734:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400880.558338:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786400881.499821:0:11328:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 18:27:58 (1786400878) === 00010000:00010000:3.0:1786400881.582436:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400881.683623:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400881.683687:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400881.683727:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850087808 00000100:00100000:1.0:1786400881.683742:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850087808 00000100:00100000:1.0:1786400881.683833:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14 00000100:00100000:1.0:1786400881.683850:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff69b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+6:2365:x1873176850087808:12345-192.168.204.8@tcp:41:mkdir.0 00000004:00000024:1.0:1786400881.683920:0:5788:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1786400881.684046:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff69b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+6:2365:x1873176850087808:12345-192.168.204.8@tcp:41:mkdir.0 Request processed in 202us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400881.684054:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14 00000100:00100000:2.0:1786400881.684365:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850087936 00000100:00100000:2.0:1786400881.684371:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850087936 00000100:00100000:2.0:1786400881.684407:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 0 00000100:00100000:2.0:1786400881.684415:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff69b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:096c63d9-38b8-441b-8c71-343db25fe88a+6:9671:x1873176850087936:12345-192.168.204.8@tcp:700:mkdir.0 00000100:00100000:2.0:1786400881.684467:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff69b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:096c63d9-38b8-441b-8c71-343db25fe88a+6:9671:x1873176850087936:12345-192.168.204.8@tcp:700:mkdir.0 Request processed in 52us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400881.684475:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 0 00000100:00080000:2.0:1786400881.685555:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400881.690903:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400881.690956:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850088192 00000100:00100000:1.0:1786400881.691739:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850088192 00000100:00100000:1.0:1786400881.691825:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 15 00000100:00100000:1.0:1786400881.691836:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff69b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+6:9671:x1873176850088192:12345-192.168.204.8@tcp:36:mkdir.0 00010000:00010000:1.0:1786400881.691922:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400881.692244:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091a00/0x5ccaaf4f3cb1d899 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba69 expref: 6 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.692288:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fd022e000) 00010000:00010000:1.0:1786400881.692300:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786400881.694607:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d9b8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.694634:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d9b8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.694648:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d9b8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.694671:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1d9bf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.694679:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1d9bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.694686:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1d9bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400881.697828:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:1.0:1786400881.697856:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d9b8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.697868:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d9b8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.697877:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d9b8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.697884:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138f600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400881.697890:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d9b8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.697898:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d9b8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.697917:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fe06cb700) 00010000:00010000:1.0:1786400881.697920:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400881.697925:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d9b8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.697943:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d9b8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786400881.698453:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000def533d7 reply state 00000000cbc642e4 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1d9bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400881.698542:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786400881.698807:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff69b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+7:9671:x1873176850088192:12345-192.168.204.8@tcp:36:mkdir.0 Request processed in 6968us (7921us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1786400881.698817:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 15 00010000:00010000:3.0:1786400881.702659:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1d9bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400881.702682:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1d9bf lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400881.702690:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1d9bf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400881.702696:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138f400 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786400881.702701:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1d9bf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400881.702709:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1d9bf lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400881.702730:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d6fe06cb200) 00010000:00010000:3.0:1786400881.702734:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400881.702739:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1d9bf lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400881.702759:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1d9bf lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400881.707871:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400881.708797:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850088320 00000100:00100000:2.0:1786400881.708811:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850088320 00000100:00100000:2.0:1786400881.708994:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 16 00000100:00100000:2.0:1786400881.709006:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff69b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+6:9672:x1873176850088320:12345-192.168.204.8@tcp:101:chmod.0 00010000:00010000:2.0:1786400881.709030:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400881.709055:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1d9c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6baee expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400881.709155:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c800/0x5ccaaf4f3cb1d9cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400881.709171:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c800/0x5ccaaf4f3cb1d9cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400881.709184:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c800/0x5ccaaf4f3cb1d9cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400881.709247:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1786400881.709265:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1786400881.709306:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c800/0x5ccaaf4f3cb1d9cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400881.709350:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1d9c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6baee expref: 8 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400881.709368:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c800/0x5ccaaf4f3cb1d9cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6baee expref: 7 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400881.709377:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fd022e300) 00010000:00010000:2.0:1786400881.709380:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786400881.709383:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc4e5c800, rc 0) 00000100:00100000:2.0:1786400881.709459:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff69b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+7:9672:x1873176850088320:12345-192.168.204.8@tcp:101:chmod.0 Request processed in 455us (1599us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400881.709479:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 16 00000100:00100000:2.0:1786400881.718451:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400881.718596:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850088576 00000100:00100000:0.0:1786400881.718633:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850088576 00000100:00100000:0.0:1786400881.718716:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 17 00000100:00100000:0.0:1786400881.718727:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd9f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+7:9672:x1873176850088576:12345-192.168.204.8@tcp:36:chmod.0 00010000:00010000:0.0:1786400881.718791:0:6615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400881.718821:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c800/0x5ccaaf4f3cb1d9cd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6baee expref: 7 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400881.718845:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fd022e300) 00010000:00010000:0.0:1786400881.718858:0:6615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786400881.718889:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1d9d4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400881.718905:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1d9d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400881.720159:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1d9d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786400881.720536:0:6615:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009a4389e9 reply state 000000006c32e5ab transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1d9d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400881.720547:0:6615:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1786400881.720562:0:6615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1786400881.722220:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd9f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+8:9672:x1873176850088576:12345-192.168.204.8@tcp:36:chmod.0 Request processed in 3483us (3774us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1786400881.722233:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 17 00010000:00010000:1.0:1786400881.725628:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1d9d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.725649:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1d9d4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.725657:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1d9d4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.725664:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aa800 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400881.725669:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1d9d4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.725677:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1d9d4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.725694:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fc90cd100) 00010000:00010000:1.0:1786400881.725697:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786400881.725702:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1d9d4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.725720:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1d9d4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400881.759029:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400881.759147:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850088704 00000100:00100000:1.0:1786400881.759175:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850088704 00000100:00100000:1.0:1786400881.759520:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 18 00000100:00100000:1.0:1786400881.759534:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd5b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+7:9673:x1873176850088704:12345-192.168.204.8@tcp:101:chown.0 00010000:00010000:1.0:1786400881.759570:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400881.759602:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1d9db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6baf5 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.759703:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f000/0x5ccaaf4f3cb1d9e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.759721:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f000/0x5ccaaf4f3cb1d9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.759735:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f000/0x5ccaaf4f3cb1d9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400881.759832:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1786400881.759837:0:5789:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1786400881.759923:0:5789:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f000/0x5ccaaf4f3cb1d9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.759957:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1d9db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6baf5 expref: 9 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.759985:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f000/0x5ccaaf4f3cb1d9e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6baf5 expref: 8 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.760003:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fe06cb700) 00010000:00010000:1.0:1786400881.760007:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786400881.760013:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138f000, rc 0) 00000100:00100000:1.0:1786400881.760161:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd5b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+8:9673:x1873176850088704:12345-192.168.204.8@tcp:101:chown.0 Request processed in 630us (1707us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400881.760169:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 18 00000100:00100000:0.0:1786400881.768437:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400881.768764:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850088832 00000100:00100000:1.0:1786400881.768784:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850088832 00000100:00100000:1.0:1786400881.768879:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 19 00000100:00100000:1.0:1786400881.768891:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+8:9673:x1873176850088832:12345-192.168.204.8@tcp:101:chown.0 00010000:00010000:1.0:1786400881.768922:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400881.768948:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1d9e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bafc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.769033:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1d9f0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.769049:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1d9f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.769064:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1d9f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.769082:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1d9f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.769137:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1d9f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.770329:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1d9f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.770504:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d9fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.770516:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d9fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.770523:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d9fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400881.770576:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:1.0:1786400881.770581:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786400881.770607:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d9fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.770634:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1d9f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.770641:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1d9f0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.770648:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1d9f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.770654:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138ee00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400881.770659:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1d9f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.770666:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1d9f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.770695:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fe06cb700) 00010000:00010000:1.0:1786400881.770698:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400881.770704:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1d9f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.770711:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1d9f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.770731:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1d9f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.770738:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1d9f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.770743:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1d9f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.770749:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138fa00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400881.770752:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1d9f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.770758:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1d9f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.770767:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d6fe06cb000) 00010000:00010000:1.0:1786400881.770769:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400881.770773:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1d9f7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.770778:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1d9f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.770845:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1d9e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bafc expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.770862:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d9fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bafc expref: 9 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.770870:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d6fe06cb500) 00010000:00010000:1.0:1786400881.770872:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786400881.770875:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138f600, rc 0) 00000100:00100000:1.0:1786400881.770969:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+9:9673:x1873176850088832:12345-192.168.204.8@tcp:101:chown.0 Request processed in 2078us (2541us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400881.770981:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 19 00000100:00100000:2.0:1786400881.777473:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400881.777676:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850089088 00000100:00100000:0.0:1786400881.777686:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850089088 00000100:00100000:0.0:1786400881.777747:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 20 00000100:00100000:0.0:1786400881.777771:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd5ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+9:9673:x1873176850089088:12345-192.168.204.8@tcp:36:chown.0 00010000:00010000:0.0:1786400881.777830:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400881.777857:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f600/0x5ccaaf4f3cb1d9fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bafc expref: 9 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400881.777882:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d6fe06cb500) 00010000:00010000:0.0:1786400881.777895:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786400881.777921:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1da05 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400881.777935:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1da05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400881.777945:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1da05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786400881.848482:0:5788:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000755b3c09 reply state 00000000d6b64d24 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1da05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400881.848503:0:5788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1786400881.848765:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1786400881.848910:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd5ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+10:9673:x1873176850089088:12345-192.168.204.8@tcp:36:chown.0 Request processed in 71135us (71441us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1786400881.848921:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 20 00000001:00080000:2.0:1786400881.850173:0:5810:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:1.0:1786400881.850265:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1da05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.850288:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1da05 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.850296:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1da05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.850302:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aa600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400881.850307:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1da05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.850315:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1da05 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.850335:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d6fc90cd200) 00010000:00010000:1.0:1786400881.850352:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786400881.850359:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1da05 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.850364:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1da05 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400881.869852:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400881.870034:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850089216 00000100:00100000:1.0:1786400881.870049:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850089216 00000100:00100000:1.0:1786400881.870259:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 21 00000100:00100000:1.0:1786400881.870274:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd5bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+6:9674:x1873176850089216:12345-192.168.204.8@tcp:101:touch.500 00010000:00010000:1.0:1786400881.870309:0:6615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400881.870338:0:6615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1da0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bb03 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786400881.872124:0:6615:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1712us 00010000:00010000:0.0:1786400881.894854:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1da13 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400881.894888:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1da13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400881.894904:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1da13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400881.894925:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1da1a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400881.894933:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1da1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400881.894940:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1da1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.896738:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1da21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.896761:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1da21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.896775:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1da21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400881.896866:0:6615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1786400881.896871:0:6615:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786400881.897043:0:6615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1da21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.897061:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1da13 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.897076:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1da13 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.897191:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1da13 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.897200:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aa600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400881.897205:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1da13 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.897300:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1da13 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.897316:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fe06cb700) 00010000:00010000:1.0:1786400881.897320:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400881.897327:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1da13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.897333:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1da13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.897349:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1da1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.897355:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1da1a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.897360:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1da1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.897365:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aa800 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400881.897374:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1da1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.897380:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1da1a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.897388:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d6fc90cd100) 00010000:00010000:1.0:1786400881.897390:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400881.897393:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1da1a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.897398:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1da1a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.897453:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1da0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb03 expref: 8 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.897473:0:6615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1da21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb03 expref: 7 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.897480:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d6fe06cb000) 00010000:00010000:1.0:1786400881.897482:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1786400881.897485:0:6615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138fa00, rc 0) 00000100:00100000:1.0:1786400881.897588:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd5bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+7:9674:x1873176850089216:12345-192.168.204.8@tcp:101:touch.500 Request processed in 27317us (27751us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400881.897599:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 21 00000100:00100000:2.0:1786400881.902331:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400881.902464:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850089472 00000100:00100000:1.0:1786400881.902479:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850089472 00000100:00100000:1.0:1786400881.902647:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 22 00000100:00100000:1.0:1786400881.902660:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd5b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+7:9674:x1873176850089472:12345-192.168.204.8@tcp:101:touch.500 00010000:00010000:1.0:1786400881.902701:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400881.902728:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1da28 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bb0a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.903426:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1da2f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.903447:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1da2f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.903462:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1da2f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.903712:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1da36 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.903738:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1da36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.903752:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1da36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786400881.904847:0:5789:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1786400881.905219:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1da3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.905233:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1da3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.905244:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1da3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.905314:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1da2f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.905322:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1da2f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.905330:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1da2f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.905337:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138f400 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400881.905341:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1da2f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.905349:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1da2f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.905363:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d6fe06cb000) 00010000:00010000:1.0:1786400881.905366:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400881.905372:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1da2f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.905378:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1da2f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786400881.905409:0:5789:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009882942e reply state 000000001ba18f6e transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1da36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400881.905420:0:5789:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786400881.905459:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1da28 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb0a expref: 10 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.905487:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1da3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb0a expref: 9 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.905496:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d6fe06cb500) 00010000:00010000:1.0:1786400881.905498:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786400881.905501:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138e600, rc 0) 00000100:00100000:1.0:1786400881.905584:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd5b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+10:9674:x1873176850089472:12345-192.168.204.8@tcp:101:touch.500 Request processed in 2928us (3268us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1786400881.905594:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 22 00010000:00010000:1.0:1786400881.910862:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1da36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.910882:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1da36 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.910891:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1da36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.910898:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138f800 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400881.910903:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1da36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.910912:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1da36 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.910931:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x369fa11a (ffff9d6fe06cbe00) 00010000:00010000:1.0:1786400881.910934:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400881.910939:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1da36 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.910964:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1da36 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400881.912405:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400881.912544:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850089728 00000100:00100000:3.0:1786400881.912559:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850089728 00000100:00100000:3.0:1786400881.912637:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 23 00000100:00100000:3.0:1786400881.912650:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd000380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+9:9674:x1873176850089728:12345-192.168.204.8@tcp:36:touch.500 00010000:00010000:2.0:1786400881.913559:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400881.913598:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1da3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb0a expref: 9 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400881.913623:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d6fe06cb500) 00010000:00010000:2.0:1786400881.913637:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786400881.913696:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5de00/0x5ccaaf4f3cb1da4b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400881.913713:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5de00/0x5ccaaf4f3cb1da4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400881.913724:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5de00/0x5ccaaf4f3cb1da4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786400881.913911:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bb2e7394 reply state 00000000fcd581ad transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5de00/0x5ccaaf4f3cb1da4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400881.913923:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786400881.914055:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd000380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+10:9674:x1873176850089728:12345-192.168.204.8@tcp:36:touch.500 Request processed in 1406us (1662us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1786400881.914063:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 23 00010000:00010000:1.0:1786400881.917433:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5de00/0x5ccaaf4f3cb1da4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.917454:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5de00/0x5ccaaf4f3cb1da4b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.917464:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5de00/0x5ccaaf4f3cb1da4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.917470:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5de00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400881.917476:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5de00/0x5ccaaf4f3cb1da4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.917485:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5de00/0x5ccaaf4f3cb1da4b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.917504:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d6fd022e500) 00010000:00010000:1.0:1786400881.917508:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400881.917512:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5de00/0x5ccaaf4f3cb1da4b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400881.917518:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5de00/0x5ccaaf4f3cb1da4b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400881.918599:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400881.920393:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850089856 00000100:00100000:0.0:1786400881.920413:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850089856 00000100:00100000:0.0:1786400881.920560:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 24 00000100:00100000:0.0:1786400881.920573:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd000700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+9:9674:x1873176850089856:12345-192.168.204.8@tcp:101:touch.500 00010000:00010000:0.0:1786400881.920608:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400881.920642:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1da52 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bb11 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400881.920737:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1da52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb11 expref: 10 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400881.920756:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1da52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb11 expref: 10 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400881.920783:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d6fc90cdf00) 00010000:00010000:0.0:1786400881.920787:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786400881.920791:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5aaa00, rc 0) 00000100:00100000:0.0:1786400881.920887:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd000700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+10:9674:x1873176850089856:12345-192.168.204.8@tcp:101:touch.500 Request processed in 316us (2302us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400881.920895:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 24 00000100:00100000:2.0:1786400881.925473:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400881.925684:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850089984 00000100:00100000:0.0:1786400881.925698:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850089984 00000100:00100000:0.0:1786400881.925812:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 16 00000100:00100000:0.0:1786400881.925826:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd003b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2361:x1873176850089984:12345-192.168.204.8@tcp:8:touch.500 00010000:00080000:0.0:1786400881.925873:0:6590:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 096c63d9-38b8-441b-8c71-343db25fe88a@192.168.204.8@tcp t0 exp 0000000000000000 cur 334 last 0 00000020:00000080:0.0:1786400881.925917:0:6590:0:(genops.c:1406:class_connect()) connect: client 096c63d9-38b8-441b-8c71-343db25fe88a, cookie 0x5ccaaf4f3cb1da59 00002000:00100000:0.0:1786400881.925953:0:6590:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 096c63d9-38b8-441b-8c71-343db25fe88a/ffff9d6ffd55d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366c ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1786400881.925997:0:6590:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1786400881.926846:0:6590:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1786400881.926901:0:6590:0:(import.c:65:import_set_state_nolock()) ffff9d6ffd55b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786400881.927174:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd003b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+6:2361:x1873176850089984:12345-192.168.204.8@tcp:8:touch.500 Request processed in 1347us (1721us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400881.927183:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 16 00000100:00100000:2.0:1786400881.930763:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400881.930894:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850090112 00000100:00100000:3.0:1786400881.930910:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850090112 00000100:00100000:3.0:1786400881.931328:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 17 00000100:00100000:3.0:1786400881.931343:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fcbb15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+6:0:x1873176850090112:12345-192.168.204.8@tcp:2:touch.500 00000100:00080000:2.0:1786400881.931866:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:2.0:1786400881.993308:0:7501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 096c63d9-38b8-441b-8c71-343db25fe88a 00000001:00080000:2.0:1786400881.993354:0:7501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:0.0:1786400881.993819:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fcbb15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+5:0:x1873176850090112:12345-192.168.204.8@tcp:2:touch.500 Request processed in 62470us (63061us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1786400881.993834:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 17 00000100:00100000:0.0:1786400882.001953:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400882.002049:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850090368 00000100:00100000:1.0:1786400882.002064:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850090368 00000100:00100000:1.0:1786400882.002332:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2 00000100:00100000:1.0:1786400882.002344:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+10:9674:x1873176850090368:12345-192.168.204.8@tcp:35:touch.500 00000100:00100000:1.0:1786400882.003266:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+11:9674:x1873176850090368:12345-192.168.204.8@tcp:35:touch.500 Request processed in 917us (1321us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1786400882.003279:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2 00000100:00100000:3.0:1786400882.015379:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400882.015954:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850090496 00000100:00100000:1.0:1786400882.016029:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850090496 00000100:00100000:1.0:1786400882.016165:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 25 00000100:00100000:1.0:1786400882.016178:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc926bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+11:9675:x1873176850090496:12345-192.168.204.8@tcp:101:rm.0 00010000:00010000:1.0:1786400882.016213:0:6615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400882.016242:0:6615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1da60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bb18 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400882.016350:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1da67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400882.016368:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1da67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400882.016382:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1da67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400882.016466:0:6615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1786400882.016470:0:6615:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1786400882.017061:0:6615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1da67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.017121:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1da60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb18 expref: 13 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.017211:0:6615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1da67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb18 expref: 12 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.017223:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d6fe06cb000) 00010000:00010000:0.0:1786400882.017226:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786400882.017231:0:6615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138ee00, rc 0) 00000100:00100000:0.0:1786400882.017376:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc926bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+12:9675:x1873176850090496:12345-192.168.204.8@tcp:101:rm.0 Request processed in 1199us (2011us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400882.017386:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 25 00000100:00100000:2.0:1786400882.021473:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400882.021655:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850090752 00000100:00100000:0.0:1786400882.021687:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850090752 00000100:00100000:0.0:1786400882.021809:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 26 00000100:00100000:0.0:1786400882.021822:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd003480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+12:9675:x1873176850090752:12345-192.168.204.8@tcp:101:rm.0 00010000:00010000:0.0:1786400882.021850:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400882.021877:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1da6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bb1f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400882.022262:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1786400882.022479:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1da6e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb1f expref: 14 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.022509:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fe06cb700) 00010000:00010000:0.0:1786400882.022512:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786400882.022519:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1da6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb1f expref: 14 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.022538:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5aa400, rc 0) 00000100:00100000:0.0:1786400882.022720:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd003480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+13:9675:x1873176850090752:12345-192.168.204.8@tcp:101:rm.0 Request processed in 900us (1265us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1786400882.022729:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 26 00000100:00100000:3.0:1786400882.027866:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400882.028309:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850090880 00000100:00100000:0.0:1786400882.028323:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850090880 00000100:00100000:0.0:1786400882.028388:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 3 00000100:00100000:0.0:1786400882.028399:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc926a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+13:9675:x1873176850090880:12345-192.168.204.8@tcp:37:rm.0 00000100:00100000:0.0:1786400882.036014:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc926a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+13:9675:x1873176850090880:12345-192.168.204.8@tcp:37:rm.0 Request processed in 7601us (8147us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400882.036034:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 3 00000100:00100000:2.0:1786400882.040597:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400882.040755:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850091136 00000100:00100000:1.0:1786400882.040770:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850091136 00000100:00100000:1.0:1786400882.040851:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4 00000100:00100000:1.0:1786400882.040863:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6d7f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+13:9675:x1873176850091136:12345-192.168.204.8@tcp:35:rm.0 00000100:00100000:1.0:1786400882.041597:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6d7f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+14:9675:x1873176850091136:12345-192.168.204.8@tcp:35:rm.0 Request processed in 732us (1013us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1786400882.041621:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4 00000100:00100000:3.0:1786400882.044768:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400882.044894:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850091392 00000100:00100000:2.0:1786400882.044908:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850091392 00000100:00100000:2.0:1786400882.045045:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 27 00000100:00100000:2.0:1786400882.045059:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc926a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+14:9675:x1873176850091392:12345-192.168.204.8@tcp:101:rm.0 00010000:00010000:2.0:1786400882.045136:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400882.045224:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1da7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bb26 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400882.045398:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1da83 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400882.045415:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1da83 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400882.045428:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1da83 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400882.045442:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1786400882.045786:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1da7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb26 expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400882.045809:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1da83 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb26 expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400882.045819:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d6fe06cb000) 00010000:00010000:2.0:1786400882.045822:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1786400882.045826:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc4e5da00, rc 0) 00000100:00100000:2.0:1786400882.045904:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc926a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+16:9675:x1873176850091392:12345-192.168.204.8@tcp:101:rm.0 Request processed in 847us (1402us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1786400882.045923:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 27 00000100:00100000:2.0:1786400882.049791:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400882.049924:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850091520 00000100:00100000:1.0:1786400882.049938:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850091520 00000100:00100000:1.0:1786400882.050065:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 28 00000100:00100000:1.0:1786400882.050077:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd002300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+16:9675:x1873176850091520:12345-192.168.204.8@tcp:41:rm.0 00000004:00000024:1.0:1786400882.050333:0:5789:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1786400882.050434:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd002300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+16:9675:x1873176850091520:12345-192.168.204.8@tcp:41:rm.0 Request processed in 358us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400882.050443:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 28 00000100:00100000:1.0:1786400882.054032:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400882.054135:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850091648 00000100:00100000:0.0:1786400882.054149:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850091648 00000100:00100000:0.0:1786400882.054215:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 29 00000100:00100000:0.0:1786400882.054225:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff69b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+16:9675:x1873176850091648:12345-192.168.204.8@tcp:101:rm.0 00010000:00010000:0.0:1786400882.054264:0:6615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400882.054293:0:6615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1da91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bb2d expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.054379:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1da98 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.054397:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1da98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.054411:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1da98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.054427:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1da9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.054434:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1da9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.054440:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1da9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.054776:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1daa6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.054786:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1daa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.054814:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1daa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400882.054848:0:6615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1786400882.054853:0:6615:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786400882.054873:0:6615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1daa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.054886:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1daa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.054895:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1da98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.054903:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1da98 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.054911:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1da98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.054918:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5ab200 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400882.054923:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1da98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.054931:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1da98 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.054945:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d6fe06cb000) 00010000:00010000:0.0:1786400882.054948:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400882.054953:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1da98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.054970:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1da98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.054987:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1da9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.054993:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1da9f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.054999:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1da9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.055004:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5ab600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400882.055007:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1da9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.055013:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1da9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.055020:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x369fa11a (ffff9d6fc90cd800) 00010000:00010000:0.0:1786400882.055022:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400882.055025:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1da9f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.055031:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1da9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.055067:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1da91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb2d expref: 18 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.055080:0:6615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1daa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb2d expref: 17 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.055438:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d6fc90cdf00) 00010000:00010000:0.0:1786400882.055441:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786400882.055444:0:6615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5aa200, rc 0) 00000100:00100000:0.0:1786400882.055584:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff69b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+17:9675:x1873176850091648:12345-192.168.204.8@tcp:101:rm.0 Request processed in 1359us (1564us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400882.055594:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 29 00000100:00100000:3.0:1786400882.058850:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400882.059057:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850091904 00000100:00100000:0.0:1786400882.059070:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850091904 00000100:00100000:0.0:1786400882.059357:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 30 00000100:00100000:0.0:1786400882.059370:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc926b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+17:9675:x1873176850091904:12345-192.168.204.8@tcp:36:rm.0 00010000:00010000:0.0:1786400882.059445:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1786400882.059479:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1daa6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb2d expref: 17 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.059630:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1da52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb11 expref: 16 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.059645:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d6fc90cdf00) 00010000:00010000:0.0:1786400882.059665:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1da67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb18 expref: 15 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.059677:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d6fe06cb000) 00010000:00010000:0.0:1786400882.059681:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786400882.059707:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1daad lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.059743:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1daad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.059754:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1daad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.059772:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1dab4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.059779:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1dab4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.059786:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1dab4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.059923:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1dabb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.059929:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1dabb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.059936:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1dabb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786400882.061116:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1786400882.061396:0:5788:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 334462046576ns, next at 335462042896ns, rc = 0 00010000:00010000:0.0:1786400882.061493:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1dac2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.061509:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1dac2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.061658:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1dac2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.061668:0:5788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1dac2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.061674:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1dac2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.061680:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1dac2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.061761:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786400882.061789:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1dabb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.061796:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1dabb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.061802:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1dabb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.061807:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5ab400 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400882.061812:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1dabb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.061821:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1dabb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.061834:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d6fc90cdc00) 00010000:00010000:0.0:1786400882.061838:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1786400882.061849:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1dabb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.061855:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1dabb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.061879:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1daad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.061885:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1daad lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.061892:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1daad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.061897:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aac00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400882.061900:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1daad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.061907:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1daad lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.061915:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d6fe06cb000) 00010000:00010000:0.0:1786400882.061917:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400882.061920:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1daad lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400882.061926:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1daad lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786400882.061937:0:5788:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004a8ec0e6 reply state 0000000058e4b3e6 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1dab4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400882.061957:0:5788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786400882.062078:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc926b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+16:9675:x1873176850091904:12345-192.168.204.8@tcp:36:rm.0 Request processed in 2706us (3237us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1786400882.062113:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 30 00010000:00010000:2.0:1786400882.064027:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400882.064044:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1dac2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400882.064058:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aa800 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:2.0:1786400882.064063:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1dac2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400882.064073:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1dac2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400882.064648:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9d6fc90cdc00) 00010000:00010000:2.0:1786400882.064654:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786400882.064660:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1dac2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400882.064669:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1dac2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400882.064703:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400882.064705:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400882.064707:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400882.067412:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400882.070667:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850092160 00000100:00100000:0.0:1786400882.070688:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850092160 00000100:00100000:0.0:1786400882.070781:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 5 00000100:00100000:0.0:1786400882.070794:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc926a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+16:9675:x1873176850092160:12345-192.168.204.8@tcp:35:rm.0 00000100:00100000:0.0:1786400882.071620:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc926a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+17:9675:x1873176850092160:12345-192.168.204.8@tcp:35:rm.0 Request processed in 692us (4087us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1786400882.071631:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 5 00010000:00010000:1.0:1786400882.072425:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1dab4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400882.072443:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1dab4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400882.072451:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1dab4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400882.072458:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aba00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400882.072464:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1dab4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400882.072472:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1dab4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400882.072502:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x369fa11a (ffff9d6fc90cd500) 00010000:00010000:1.0:1786400882.072506:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400882.072767:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1dab4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400882.072775:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1dab4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x369fa11a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400882.074870:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400882.074975:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850092416 00000100:00100000:1.0:1786400882.074987:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850092416 00000100:00100000:1.0:1786400882.075311:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 31 00000100:00100000:1.0:1786400882.075323:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd001880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+16:9675:x1873176850092416:12345-192.168.204.8@tcp:36:rm.0 00010000:00010000:1.0:1786400882.075407:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1786400882.075440:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1da83 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb26 expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400882.075465:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1da21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb03 expref: 15 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400882.075479:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d6fe06cb000) 00010000:00010000:1.0:1786400882.075569:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f000/0x5ccaaf4f3cb1d9e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6baf5 expref: 14 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400882.075581:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fe06cb700) 00010000:00010000:1.0:1786400882.075590:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786400882.075624:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dac9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400882.075640:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dac9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400882.075651:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dac9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400882.075684:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1dad0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400882.075693:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1dad0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400882.075700:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1dad0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400882.076332:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1dad7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400882.076343:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1dad7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400882.076352:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1dad7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400882.077831:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1786400882.077860:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1dad7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400882.077871:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1dad7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400882.077878:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1dad7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400882.077884:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138ee00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400882.077890:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1dad7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400882.077911:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1dad7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400882.077928:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9d6fe06cba00) 00010000:00010000:1.0:1786400882.077932:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786400882.077936:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1dad7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400882.077941:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1dad7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400882.078044:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dac9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400882.078051:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dac9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400882.078058:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dac9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400882.078064:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138e800 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400882.078067:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dac9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400882.078072:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dac9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400882.078081:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fe06cbe00) 00010000:00010000:1.0:1786400882.078329:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400882.078334:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dac9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400882.078353:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dac9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786400882.078370:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000396bda73 reply state 000000008bc6422f transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1dad0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400882.078382:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786400882.078865:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd001880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+15:9675:x1873176850092416:12345-192.168.204.8@tcp:36:rm.0 Request processed in 3535us (3999us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1786400882.078878:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 31 00010000:00010000:3.0:1786400882.081666:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1dad0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400882.081687:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1dad0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400882.081695:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1dad0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400882.081701:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138ea00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786400882.081707:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1dad0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400882.081738:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1dad0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400882.081759:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d6fe06cb200) 00010000:00010000:3.0:1786400882.081762:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400882.081767:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1dad0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400882.081773:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1dad0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400882.606580:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400883.438526:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff69b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872142464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786400883.438627:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400883.438741:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872142464 00000100:00100000:0.0:1786400883.438751:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872142464 00000100:00100000:0.0:1786400883.438912:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1786400883.438925:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9269c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872142464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786400883.438974:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1786400883.439362:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786400883.439561:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9269c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872142464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 638us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400883.439571:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1786400883.439654:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff69b7800 x1873176872142464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400899 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400883.439677:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff69b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872142464:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1786400883.634128:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400883.771909:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400883.772326:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400883.776447:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400883.776495:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400883.776517:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850092544 00000100:00100000:2.0:1786400883.776526:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850092544 00000100:00100000:2.0:1786400883.777001:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 245 00000100:00100000:2.0:1786400883.777013:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2364:x1873176850092544:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:2.0:1786400883.777120:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2364:x1873176850092544:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 74us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400883.777251:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 245 00000100:00100000:1.0:1786400883.781226:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850092672 00000100:00100000:1.0:1786400883.781242:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850092672 00000100:00100000:0.0:1786400883.782044:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850092928 00000100:00100000:0.0:1786400883.782051:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850092928 00000100:00100000:0.0:1786400883.782083:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850092800 00000100:00080000:1.0:1786400883.782194:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400883.782284:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 94 00000100:00100000:1.0:1786400883.782297:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd001180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2364:x1873176850092928:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:1.0:1786400883.782795:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd001180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2364:x1873176850092928:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 500us (10468us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400883.782816:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 94 00000100:00080000:1.0:1786400883.782973:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400883.783003:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 95 00000100:00100000:1.0:1786400883.783285:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd003100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+14:2364:x1873176850092672:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:1.0:1786400883.783344:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd003100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+14:2364:x1873176850092672:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 334us (11446us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400883.783352:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 95 00000100:00100000:0.0:1786400883.784833:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850092800 00000100:00080000:1.0:1786400883.784891:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786400883.784910:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 38 00000100:00100000:0.0:1786400883.784921:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd001c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+5:2364:x1873176850092800:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786400883.785003:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd001c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+5:2364:x1873176850092800:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 84us (8508us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400883.785018:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 38 00000100:00100000:1.0:1786400883.950648:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee1d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872142592:0@lo:400:kworker.0 00000100:00100000:1.0:1786400883.950736:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400883.951075:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff69b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872142720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786400883.951129:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1786400883.952004:0:7757:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 336352916318ns, next at 337352914014ns, rc = 0 00000100:00100000:1.0:1786400883.952035:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872142592 00000100:00100000:1.0:1786400883.952042:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872142592 00000100:00100000:3.0:1786400883.952069:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786400883.952080:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872143104:0@lo:400:kworker.0 00000100:00100000:3.0:1786400883.952148:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400883.952186:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872142720 00000100:00100000:3.0:1786400883.952190:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872142720 00000100:00100000:3.0:1786400883.952252:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1786400883.952261:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc926b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872142720:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786400883.952572:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1786400883.952580:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+19:3308:x1873176872142592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400883.952633:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+19:3308:x1873176872142592:12345-0@lo:400:kworker.0 Request processed in 53us (1897us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400883.952640:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1786400883.952673:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872142848:0@lo:400:kworker.0 00000100:00100000:1.0:1786400883.952698:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400883.952719:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786400883.952726:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872142976:0@lo:400:kworker.0 00000100:00100000:1.0:1786400883.952748:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1786400883.952771:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786400883.952783:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872142848 00000100:00100000:1.0:1786400883.952787:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872142848 00000100:00100000:1.0:1786400883.952813:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872142976 00000100:00100000:1.0:1786400883.952816:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872142976 00000100:00100000:1.0:1786400883.952837:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1786400883.952844:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff69b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872142848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400883.952879:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff69b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872142848:12345-0@lo:400:kworker.0 Request processed in 35us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400883.952885:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1786400883.952896:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1786400883.952902:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff69b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872142976:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1786400883.952947:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400883.952968:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff69b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872142976:12345-0@lo:400:kworker.0 Request processed in 65us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400883.952975:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:1.0:1786400883.952996:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400883.953012:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc926b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872142720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 750us (1880us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400883.953020:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1786400883.953030:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872142976:0@lo:400:kworker.0 00000100:00100000:1.0:1786400883.953044:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872142848:0@lo:400:kworker.0 00000100:00100000:3.0:1786400883.953054:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872143104 00000100:00100000:3.0:1786400883.953059:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872143104 00000100:00100000:1.0:1786400883.953083:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee1d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872142592:0@lo:400:kworker.0 00000100:00100000:3.0:1786400883.953110:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1786400883.953120:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc926b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872143104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400883.953155:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc926b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872143104:12345-0@lo:400:kworker.0 Request processed in 37us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400883.953162:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1786400883.953197:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff692c000 x1873176872143104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400899 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400883.953220:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872143104:0@lo:400:kworker.0 00010000:00080000:3.0:1786400883.953234:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff69b7800 x1873176872142720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400899 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400883.953248:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff69b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872142720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786400883.955319:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786400883.955340:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873176872143232:0@lo:400:kworker.0 00000100:00100000:2.0:1786400883.955396:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400883.955456:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872143232 00000100:00100000:0.0:1786400883.955464:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872143232 00000100:00100000:0.0:1786400883.955530:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1786400883.955539:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd000a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873176872143232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400883.955589:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd000a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873176872143232:12345-0@lo:400:kworker.0 Request processed in 51us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400883.955596:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:2.0:1786400883.956242:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786400883.956278:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873176872143232:0@lo:400:kworker.0 00010000:00010000:2.0:1786400884.654376:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400885.681221:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786400886.512892:0:11479:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1786400886.702731:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1786400887.062617:0:5810:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:2.0:1786400887.062636:0:5810:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1786400887.062832:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786400887.062851:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872143360:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1786400887.062932:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400887.063330:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872143360 00000100:00100000:0.0:1786400887.063338:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872143360 00000100:00100000:0.0:1786400887.063402:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1786400887.063412:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872143360:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1786400887.063441:0:6593:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1786400887.063478:0:6593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a7a5070, atime: 0x6a7a5070, ctime: 0x6a7a5070, blocks: 0x1 00010000:00010000:0.0:1786400887.063488:0:6593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074c3fdff/0x5ccaaf4f3cb1dade lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400887.063507:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1786400887.063511:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786400887.063518:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074c3fdff/0x5ccaaf4f3cb1dade lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400887.063536:0:6593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074c3fdff/0x5ccaaf4f3cb1dade lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400887.063561:0:6593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074c3fdff/0x5ccaaf4f3cb1dade lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400887.063569:0:6593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074c3fdff/0x5ccaaf4f3cb1dade lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400887.063587:0:6593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:2.0:1786400887.064111:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786400887.064553:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1873176872143360:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1140us (1618us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1786400887.064562:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1786400887.064589:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786400887.064594:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074c3fdff/0x5ccaaf4f3cb1dade lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400887.064604:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aa400 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:0.0:1786400887.064609:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074c3fdff/0x5ccaaf4f3cb1dade lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400887.064620:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074c3fdff/0x5ccaaf4f3cb1dade lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400887.064638:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074c3fdff/0x5ccaaf4f3cb1dade lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400887.064645:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074c3fdff/0x5ccaaf4f3cb1dade lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400887.064672:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400887.064674:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400887.064676:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1786400887.064926:0:5810:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:0.0:1786400887.064956:0:5810:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1786400887.068070:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d6ff692e300/2, rc 0, transno 4294967300 00000100:00100000:2.0:1786400887.068107:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872143360:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1786400887.726854:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1786400887.796687:0:11528:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffd68d516c0 00000020:00000080:2.0:1786400887.796706:0:11528:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:2.0:1786400887.796711:0:11528:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:2.0:1786400887.796719:0:11528:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd68d53950 20000000:00000080:2.0:1786400887.796726:0:11528:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d6ffd9fdc00 uarg=0000000000000000 20000000:01000000:2.0:1786400887.796763:0:11528:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1786400887.796774:0:11528:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1786400887.796781:0:11528:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1786400887.797618:0:11529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1786400887.797785:0:11528:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1786400887.802298:0:11528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1786400887.802354:0:11528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1786400887.802409:0:11528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1786400887.802426:0:11528:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1786400887.802445:0:11528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1dae5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400887.802463:0:11528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1d987 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d980 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400887.802471:0:11528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1d995 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d98e expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400887.802477:0:11528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fe7d39200/0x5ccaaf4f3cb1d9a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d99c expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400887.802486:0:11528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1d9aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bae0 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400887.802493:0:11528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1d9b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bae7 expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400887.802501:0:11528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1dae5 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400887.802541:0:11528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1d9b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bae7 expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400887.802569:0:11528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1d9b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bae7 expref: 12 pid: 5781 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400887.802585:0:11528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd001500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11528:1873176872143488:192.168.204.8@tcp:104: 00010000:00010000:2.0:1786400887.802906:0:11528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1d9aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bae0 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400887.802916:0:11528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1d9aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bae0 expref: 12 pid: 5783 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400887.802924:0:11528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd003800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11528:1873176872143616:192.168.204.8@tcp:104: 00010000:00010000:2.0:1786400887.802955:0:11528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fe7d39200/0x5ccaaf4f3cb1d9a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d99c expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400887.802962:0:11528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fe7d39200/0x5ccaaf4f3cb1d9a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d99c expref: 18 pid: 5781 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400887.802971:0:11528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd000e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11528:1873176872143744:0@lo:104: 00000100:00100000:2.0:1786400887.803012:0:11528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786400887.806109:0:11528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1d995 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d98e expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400887.806127:0:11528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1d995 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d98e expref: 18 pid: 5783 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400887.806153:0:11528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd002680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11528:1873176872143872:0@lo:104: 00000100:00100000:2.0:1786400887.806204:0:11528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1786400887.806250:0:11528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1d987 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d980 expref: 18 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400887.806259:0:11528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1d987 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d980 expref: 18 pid: 5780 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400887.806268:0:11528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd002a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11528:1873176872144000:0@lo:104: 00000100:00100000:2.0:1786400887.806296:0:11528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400887.806323:0:11528:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc5455cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786400887.806566:0:5772:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1786400887.806579:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872143744 00000100:00100000:1.0:1786400887.806585:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872143744 00000100:00100000:1.0:1786400887.806625:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872143872 00000100:00100000:1.0:1786400887.806628:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872143872 00000100:00100000:1.0:1786400887.806639:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872144000 00000100:00100000:1.0:1786400887.806641:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872144000 00000100:00100000:1.0:1786400887.806654:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1786400887.806663:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd000000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:97b0324f-e214-4822-8711-e150ddac2a7e+5:11528:x1873176872143744:12345-0@lo:104: 00010000:00010000:1.0:1786400887.806676:0:5772:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1d99c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d9a3 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400887.806742:0:5772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786400887.806749:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd000000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:97b0324f-e214-4822-8711-e150ddac2a7e+5:11528:x1873176872143744:12345-0@lo:104: Request processed in 87us (3736us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400887.806757:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1786400887.806775:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1786400887.806781:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd001f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:97b0324f-e214-4822-8711-e150ddac2a7e+4:11528:x1873176872143872:12345-0@lo:104: 00010000:00010000:1.0:1786400887.806788:0:5772:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1d98e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d995 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400887.806828:0:5772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1786400887.806834:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd001f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:97b0324f-e214-4822-8711-e150ddac2a7e+4:11528:x1873176872143872:12345-0@lo:104: Request processed in 53us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400887.806840:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1786400887.806867:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1786400887.806873:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f5c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:97b0324f-e214-4822-8711-e150ddac2a7e+3:11528:x1873176872144000:12345-0@lo:104: 00010000:00010000:1.0:1786400887.806880:0:5772:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1d980 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d987 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400887.806906:0:5772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1786400887.806911:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f5c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:97b0324f-e214-4822-8711-e150ddac2a7e+3:11528:x1873176872144000:12345-0@lo:104: Request processed in 39us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400887.806916:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1786400887.806957:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1786400887.806963:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1d99c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d9a3 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400887.806970:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7d39600 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:1.0:1786400887.806974:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1d99c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5ccaaf4f3cb1d9a3 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400887.806983:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1d99c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5ccaaf4f3cb1d9a3 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786400887.806992:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1d99c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5ccaaf4f3cb1d9a3 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400887.806998:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1786400887.807028:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1d99c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d9a3 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400887.807034:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786400887.807052:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1d99c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d9a3 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400887.807065:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1d99c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d9a3 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400887.807078:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786400887.807082:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1d98e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d995 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400887.807115:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7d38000 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:1.0:1786400887.807119:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1d98e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5ccaaf4f3cb1d995 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400887.807126:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1d98e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5ccaaf4f3cb1d995 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786400887.807144:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1d98e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5ccaaf4f3cb1d995 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400887.807149:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1786400887.807162:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1d98e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d995 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400887.807167:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786400887.807182:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1d98e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d995 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400887.807198:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1d98e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d995 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400887.807206:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786400887.807209:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1d980 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1d987 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400887.807214:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5d600 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:1.0:1786400887.807217:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1d980 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5ccaaf4f3cb1d987 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400887.807224:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1d980 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5ccaaf4f3cb1d987 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786400887.807231:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1d980 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5ccaaf4f3cb1d987 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786400887.807236:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1786400887.807250:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1d980 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d987 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400887.807256:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786400887.807263:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1d980 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d987 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400887.807269:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1d980 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1d987 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400887.807281:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400887.807288:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400887.807289:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400887.807302:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff69b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:97b0324f-e214-4822-8711-e150ddac2a7e:3307:1873176872144128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786400887.807349:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400887.807386:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff69b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872144256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786400887.807408:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400887.807424:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786400887.807429:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee1d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872144384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786400887.807446:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400887.807465:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872144128 00000100:00100000:1.0:1786400887.807469:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872144128 00010000:00010000:1.0:1786400887.807486:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fe7d39200/0x5ccaaf4f3cb1d9a3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d99c expref: 19 pid: 5781 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400887.807505:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872144256 00000100:00100000:1.0:1786400887.807507:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872144256 00010000:00010000:1.0:1786400887.807515:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1d995 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d98e expref: 20 pid: 5783 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400887.807523:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872144384 00000100:00100000:1.0:1786400887.807524:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872144384 00010000:00010000:1.0:1786400887.807531:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1d987 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d980 expref: 21 pid: 5780 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400887.807540:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1786400887.807545:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc34c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:97b0324f-e214-4822-8711-e150ddac2a7e+21:3307:x1873176872144128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786400887.807553:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400887.807557:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fe7d39200/0x5ccaaf4f3cb1d9a3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d99c expref: 21 pid: 5781 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400887.807577:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fe7d39200/0x5ccaaf4f3cb1d9a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d99c expref: 21 pid: 5781 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400887.807594:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400887.807620:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc34c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:97b0324f-e214-4822-8711-e150ddac2a7e+21:3307:x1873176872144128:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400887.807627:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1786400887.807640:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1786400887.807645:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc34c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:97b0324f-e214-4822-8711-e150ddac2a7e+20:3308:x1873176872144256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786400887.807652:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400887.807656:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1d995 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d98e expref: 20 pid: 5783 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400887.807665:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1d995 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d98e expref: 20 pid: 5783 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400887.807673:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400887.807698:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc34c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:97b0324f-e214-4822-8711-e150ddac2a7e+20:3308:x1873176872144256:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400887.807704:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1786400887.807716:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1786400887.807722:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc458a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:97b0324f-e214-4822-8711-e150ddac2a7e+19:3308:x1873176872144384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786400887.807729:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400887.807733:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1d987 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d980 expref: 19 pid: 5780 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400887.807741:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1d987 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d980 expref: 19 pid: 5780 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400887.807757:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400887.807778:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc458a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:97b0324f-e214-4822-8711-e150ddac2a7e+19:3308:x1873176872144384:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400887.807783:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1786400887.807845:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee1d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872144384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786400887.807853:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff69b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872144256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786400887.807881:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff69b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:97b0324f-e214-4822-8711-e150ddac2a7e:3307:1873176872144128:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786400887.808214:0:11528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe7d39200/0x5ccaaf4f3cb1d9a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d99c expref: 18 pid: 5781 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400887.808227:0:11528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd000e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11528:1873176872143744:0@lo:104: 00010000:00010000:2.0:1786400887.808238:0:11528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1d995 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d98e expref: 17 pid: 5783 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400887.808245:0:11528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd002680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11528:1873176872143872:0@lo:104: 00010000:00010000:2.0:1786400887.808253:0:11528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1d987 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1d980 expref: 16 pid: 5780 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400887.808261:0:11528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd002a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11528:1873176872144000:0@lo:104: 00010000:00010000:3.0:1786400887.808436:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400887.814267:0:11528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd001500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11528:1873176872143488:192.168.204.8@tcp:104: 00000100:00100000:2.0:1786400887.814283:0:11528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd003800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11528:1873176872143616:192.168.204.8@tcp:104: 00010000:00010000:2.0:1786400887.814317:0:11528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1dae5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400887.815697:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400887.815783:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400887.815859:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850093056 00000100:00100000:0.0:1786400887.815868:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850093056 00010000:00010000:0.0:1786400887.815907:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1d9b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bae7 expref: 13 pid: 5781 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400887.815973:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850093184 00000100:00100000:0.0:1786400887.815977:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850093184 00010000:00010000:0.0:1786400887.815991:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1d9aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bae0 expref: 14 pid: 5783 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400887.816245:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 33 00000100:00100000:1.0:1786400887.816258:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc34c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+14:2365:x1873176850093056:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400887.816272:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400887.816279:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1d9b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bae7 expref: 14 pid: 5781 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400887.816291:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1d9b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bae7 expref: 14 pid: 5781 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400887.816310:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1d9b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bae7 expref: 14 pid: 5781 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400887.816326:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400887.816423:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc34c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2365:x1873176850093056:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 168us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400887.816431:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 33 00000100:00100000:1.0:1786400887.816465:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 34 00000100:00100000:1.0:1786400887.816473:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc34c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+12:2365:x1873176850093184:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400887.816480:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400887.816485:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1d9aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bae0 expref: 12 pid: 5783 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400887.816495:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1d9aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bae0 expref: 12 pid: 5783 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400887.816505:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1d9aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bae0 expref: 12 pid: 5783 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400887.816516:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1dae5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400887.816524:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1dae5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400887.816539:0:5775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1dae5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400887.816546:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1dae5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400887.816971:0:5775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1dae5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400887.816982:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1dae5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400887.816989:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5da00 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:1.0:1786400887.817001:0:5775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1dae5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400887.817011:0:5775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1dae5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400887.817249:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1dae5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400887.817264:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400887.817299:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc34c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+11:2365:x1873176850093184:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 825us (1514us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400887.817307:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 34 00010000:00010000:2.0:1786400887.817704:0:11528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1dae5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400887.817729:0:11528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1dae5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400887.817735:0:11528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1dae5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400888.559373:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc34c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872144512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786400888.559444:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400888.559562:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872144512 00000100:00100000:3.0:1786400888.559570:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872144512 00000100:00100000:3.0:1786400888.559632:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1786400888.559643:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd003800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872144512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786400888.559681:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786400888.559731:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd003800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872144512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400888.559752:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1786400888.559792:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fc34c0700 x1873176872144512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400904 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400888.559809:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc34c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872144512:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1786400888.561480:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1786400888.750261:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400888.881881:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400888.881924:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400888.882163:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400888.882212:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400888.882262:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850093440 00000100:00100000:0.0:1786400888.882276:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850093440 00000100:00100000:0.0:1786400888.882361:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850093696 00000100:00100000:0.0:1786400888.882367:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850093696 00000100:00100000:0.0:1786400888.882406:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 99 00000100:00100000:0.0:1786400888.882422:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+5:2363:x1873176850093440:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786400888.882540:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+5:2363:x1873176850093440:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 120us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400888.882578:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 99 00000100:00100000:0.0:1786400888.882604:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 100 00000100:00100000:0.0:1786400888.882615:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2363:x1873176850093696:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786400888.882659:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2363:x1873176850093696:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 45us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400888.882668:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 100 00000100:00100000:2.0:1786400888.882722:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850093312 00000100:00100000:2.0:1786400888.882739:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850093312 00000100:00100000:2.0:1786400888.882817:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 247 00000100:00100000:2.0:1786400888.882828:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+11:2363:x1873176850093312:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:2.0:1786400888.882899:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+11:2363:x1873176850093312:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 74us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400888.882909:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 247 00000100:00080000:0.0:1786400888.882958:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400888.884355:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850093568 00000100:00100000:3.0:1786400888.884370:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850093568 00000100:00100000:3.0:1786400888.884451:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 40 00000100:00100000:3.0:1786400888.884463:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+5:2363:x1873176850093568:12345-192.168.204.8@tcp:400:kworker.0 00000100:00080000:2.0:1786400888.884471:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786400888.884529:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+5:2363:x1873176850093568:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 69us (2603us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400888.884536:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 40 00000100:00100000:3.0:1786400889.070413:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786400889.070446:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc34c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872144640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786400889.070530:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400889.070755:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872144640 00000100:00100000:0.0:1786400889.070766:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872144640 00000100:00100000:0.0:1786400889.070886:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1786400889.070897:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1873176872144640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786400889.070936:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786400889.070989:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1873176872144640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (460us total) trans 0 rc 0/0 00000100:00080000:3.0:1786400889.071461:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786400889.071510:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc34c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872144640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786400889.071802:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc34c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873176872144896:0@lo:400:kworker.0 00000100:00100000:3.0:1786400889.071846:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400889.071875:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1786400889.071882:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc34c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:97b0324f-e214-4822-8711-e150ddac2a7e:3309:1873176872144768:0@lo:400:kworker.0 00000100:00100000:3.0:1786400889.071911:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400889.071936:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc34c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873176872145280:0@lo:400:kworker.0 00000100:00100000:3.0:1786400889.071958:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400889.071989:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872144768 00000100:00100000:3.0:1786400889.072119:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872144768 00000100:00100000:3.0:1786400889.072157:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1786400889.072165:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+16:3309:x1873176872144768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400889.072207:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+16:3309:x1873176872144768:12345-0@lo:400:kworker.0 Request processed in 42us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400889.072215:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1786400889.072246:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872144896 00000100:00100000:3.0:1786400889.072250:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872144896 00000100:00100000:3.0:1786400889.072270:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872145280 00000100:00100000:3.0:1786400889.072272:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872145280 00000100:00100000:3.0:1786400889.072292:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1786400889.072297:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9268700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873176872144896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400889.072324:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9268700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873176872144896:12345-0@lo:400:kworker.0 Request processed in 27us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400889.072330:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1786400889.072339:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1786400889.072343:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9268380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873176872145280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400889.072364:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9268380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873176872145280:12345-0@lo:400:kworker.0 Request processed in 20us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400889.072370:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1786400889.072401:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc34c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:97b0324f-e214-4822-8711-e150ddac2a7e:3309:1873176872144768:0@lo:400:kworker.0 00000100:00100000:3.0:1786400889.072411:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc34c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873176872145280:0@lo:400:kworker.0 00000100:00100000:3.0:1786400889.072420:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc34c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873176872144896:0@lo:400:kworker.0 00000100:00080000:3.0:1786400889.072437:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400889.072686:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1786400889.072961:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc34c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872145152:0@lo:400:kworker.0 00000100:00100000:3.0:1786400889.073536:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc34c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872145024:0@lo:400:kworker.0 00000100:00100000:3.0:1786400889.073604:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400889.073665:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872145024 00000100:00100000:3.0:1786400889.073672:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872145024 00000100:00100000:1.0:1786400889.073699:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400889.073736:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1786400889.073747:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc926ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872145024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400889.074144:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc926ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872145024:12345-0@lo:400:kworker.0 Request processed in 396us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400889.074151:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:3.0:1786400889.074178:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400889.074744:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc34c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872145024:0@lo:400:kworker.0 00000100:00100000:0.0:1786400889.075426:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872145152 00000100:00100000:0.0:1786400889.075439:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872145152 00000100:00100000:0.0:1786400889.078152:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1786400889.078177:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc34c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872145152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400889.078278:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc34c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872145152:12345-0@lo:400:kworker.0 Request processed in 112us (4584us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400889.078287:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1786400889.078348:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fc34c3100 x1873176872145152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400889.078364:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc34c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872145152:0@lo:400:kworker.0 10000000:01000000:2.0:1786400889.646224:0:5785:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1786400889.646233:0:5785:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6ec470a000 from 7 10000000:01000000:2.0:1786400889.646239:0:5785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1786400889.646290:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1daec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400889.646302:0:5785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1daec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400889.646313:0:5785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1daec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400889.646357:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd001500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872145408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786400889.646428:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400889.646499:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc5455900 going to sleep for 11 seconds 00000100:00100000:1.0:1786400889.646595:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872145408 00000100:00100000:1.0:1786400889.646603:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872145408 00000100:00100000:1.0:1786400889.646669:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1786400889.646678:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+16:5785:x1873176872145408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786400889.646691:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400889.646706:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fc138f600/0x5ccaaf4f3cb1daf3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1daec expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400889.646730:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc138f600/0x5ccaaf4f3cb1daf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1daec expref: 17 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400889.646741:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fc138f600/0x5ccaaf4f3cb1daf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1daec expref: 17 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400889.646757:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138f600, rc 0) 00000100:00100000:1.0:1786400889.647429:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+17:5785:x1873176872145408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 750us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400889.647439:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1786400889.647631:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd001500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872145408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786400889.647646:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1daec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1daf3 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400889.647656:0:5785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1daec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1daf3 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400889.647715:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd001500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872145536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786400889.647747:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400889.647928:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc5455900 going to sleep for 11 seconds 00000100:00100000:3.0:1786400889.648079:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872145536 00000100:00100000:3.0:1786400889.648117:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872145536 00000100:00100000:3.0:1786400889.648293:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1786400889.648303:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+17:5785:x1873176872145536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786400889.649401:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+17:5785:x1873176872145536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1094us (1647us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400889.649412:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1786400889.650254:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd001500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872145536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786400889.650305:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd001500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872145664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786400889.650363:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400889.650401:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc5455900 going to sleep for 11 seconds 00000100:00100000:1.0:1786400889.651322:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872145664 00000100:00100000:1.0:1786400889.651331:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872145664 00000100:00100000:1.0:1786400889.651642:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1786400889.651654:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+17:5785:x1873176872145664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786400889.651896:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+17:5785:x1873176872145664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 244us (1532us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400889.651904:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1786400889.655262:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd001500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872145664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786400889.655786:0:11541:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:11541:1873176872145792:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786400889.655869:0:11541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400889.655911:0:11541:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffde17a80 going to sleep for 11 seconds 00000100:00100000:1.0:1786400889.656038:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872145792 00000100:00100000:1.0:1786400889.656045:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872145792 00000100:00100000:1.0:1786400889.656125:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1786400889.656135:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+17:11541:x1873176872145792:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786400889.656374:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+17:11541:x1873176872145792:12345-0@lo:502:llog_process_th.0 Request processed in 239us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400889.656383:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1786400889.657398:0:11541:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:11541:1873176872145792:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1786400889.657438:0:11541:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786400889.657451:0:11541:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786400889.657453:0:11541:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1786400889.657464:0:11541:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d6ec470a000 00000020:00000080:0.0:1786400889.657467:0:11541:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1786400889.657559:0:11541:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:11541:1873176872145920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786400889.657615:0:11541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400889.657658:0:11541:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffde17a80 going to sleep for 11 seconds 00000100:00100000:3.0:1786400889.658700:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872145920 00000100:00100000:3.0:1786400889.658709:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872145920 00000100:00100000:3.0:1786400889.658767:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1786400889.658778:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+17:11541:x1873176872145920:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786400889.659221:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+17:11541:x1873176872145920:12345-0@lo:502:llog_process_th.0 Request processed in 445us (1606us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400889.659229:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1786400889.662861:0:11541:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:11541:1873176872145920:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1786400889.662910:0:11541:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786400889.662922:0:11541:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786400889.662924:0:11541:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1786400889.662933:0:11541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1786400889.664318:0:5785:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1786400889.664347:0:5785:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1786400889.664359:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1daec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1daf3 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400889.664388:0:5785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1daec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1daf3 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400889.664398:0:5785:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1786400889.664401:0:5785:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6fc49f0000 from 7 10000000:01000000:3.0:1786400889.664404:0:5785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1786400889.664463:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39000/0x5ccaaf4f3cb1dafa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400889.664470:0:5785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39000/0x5ccaaf4f3cb1dafa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400889.664479:0:5785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39000/0x5ccaaf4f3cb1dafa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400889.664503:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc9269500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872146048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786400889.666515:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400889.666796:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc34e9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1786400889.667117:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872146048 00000100:00100000:3.0:1786400889.667127:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872146048 00000100:00100000:3.0:1786400889.667178:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1786400889.667187:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+17:5785:x1873176872146048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786400889.667203:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400889.667220:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe7d38200/0x5ccaaf4f3cb1db01 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1dafa expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400889.667247:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe7d38200/0x5ccaaf4f3cb1db01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1dafa expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400889.667278:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe7d38200/0x5ccaaf4f3cb1db01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1dafa expref: 18 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400889.667288:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7d38200, rc 0) 00000100:00100000:3.0:1786400889.667346:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+18:5785:x1873176872146048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400889.667353:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1786400889.667404:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc9269500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872146048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786400889.667419:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39000/0x5ccaaf4f3cb1dafa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1db01 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400889.667429:0:5785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39000/0x5ccaaf4f3cb1dafa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1db01 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400889.667495:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc9269500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872146176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786400889.667526:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400889.667546:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc34e9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1786400889.667575:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872146176 00000100:00100000:3.0:1786400889.667579:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872146176 00000100:00100000:3.0:1786400889.667595:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1786400889.667601:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc44ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+18:5785:x1873176872146176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786400889.672206:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc44ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+18:5785:x1873176872146176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4595us (4669us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400889.672223:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1786400889.672806:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc9269500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872146176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786400889.673180:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd002a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872146304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786400889.673244:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400889.673283:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc5455540 going to sleep for 11 seconds 00000100:00100000:0.0:1786400889.673670:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872146304 00000100:00100000:0.0:1786400889.673679:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872146304 00000100:00100000:0.0:1786400889.673734:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1786400889.673744:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+18:5785:x1873176872146304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786400889.674942:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+18:5785:x1873176872146304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1195us (1692us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400889.674953:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1786400889.677206:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd002a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872146304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786400889.679204:0:11543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd002a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:11543:1873176872146432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786400889.679312:0:11543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400889.679358:0:11543:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc5455840 going to sleep for 11 seconds 00000100:00100000:3.0:1786400889.679929:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872146432 00000100:00100000:3.0:1786400889.679937:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872146432 00000100:00100000:3.0:1786400889.681023:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1786400889.681041:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+18:11543:x1873176872146432:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786400889.681322:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+18:11543:x1873176872146432:12345-0@lo:502:llog_process_th.0 Request processed in 287us (2009us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400889.681330:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1786400889.683344:0:11543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd002a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:11543:1873176872146432:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1786400889.683389:0:11543:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786400889.683400:0:11543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786400889.683402:0:11543:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1786400889.683409:0:11543:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d6fc49f0000 00000020:00000080:2.0:1786400889.683411:0:11543:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1786400889.683783:0:11543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd002a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:11543:1873176872146560:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786400889.683875:0:11543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400889.683912:0:11543:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc5455840 going to sleep for 11 seconds 00000100:00100000:3.0:1786400889.686144:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872146560 00000100:00100000:3.0:1786400889.686159:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872146560 00000100:00100000:3.0:1786400889.686215:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1786400889.686225:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+18:11543:x1873176872146560:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786400889.686495:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+18:11543:x1873176872146560:12345-0@lo:502:llog_process_th.0 Request processed in 271us (2620us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400889.686503:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1786400889.687691:0:11543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd002a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:11543:1873176872146560:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1786400889.687746:0:11543:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786400889.687757:0:11543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786400889.687759:0:11543:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1786400889.687764:0:11543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1786400889.688722:0:5785:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1786400889.688744:0:5785:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1786400889.688754:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39000/0x5ccaaf4f3cb1dafa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1db01 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400889.688766:0:5785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39000/0x5ccaaf4f3cb1dafa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1db01 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400889.688777:0:5785:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1786400889.688780:0:5785:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6fc307d800 from 7 10000000:01000000:3.0:1786400889.688784:0:5785:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1786400889.688991:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38600/0x5ccaaf4f3cb1db08 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400889.689081:0:5785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38600/0x5ccaaf4f3cb1db08 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400889.689146:0:5785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38600/0x5ccaaf4f3cb1db08 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400889.689170:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc9269500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872146688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786400889.689233:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400889.689278:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffd5b1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1786400889.689703:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872146688 00000100:00100000:2.0:1786400889.689710:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872146688 00000100:00100000:2.0:1786400889.689761:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1786400889.689770:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+18:5785:x1873176872146688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786400889.689784:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400889.689798:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fc4e5ce00/0x5ccaaf4f3cb1db0f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1db08 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400889.690337:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc4e5ce00/0x5ccaaf4f3cb1db0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1db08 expref: 19 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400889.690352:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fc4e5ce00/0x5ccaaf4f3cb1db0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1db08 expref: 19 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400889.690363:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc4e5ce00, rc 0) 00000100:00100000:2.0:1786400889.690415:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+19:5785:x1873176872146688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 646us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400889.690432:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1786400889.690682:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc9269500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872146688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786400889.690700:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38600/0x5ccaaf4f3cb1db08 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1db0f expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400889.690710:0:5785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38600/0x5ccaaf4f3cb1db08 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1db0f expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400889.690774:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc9269500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872146816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786400889.690809:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400889.691861:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffd5b1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1786400889.691991:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872146816 00000100:00100000:2.0:1786400889.692008:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872146816 00000100:00100000:2.0:1786400889.692185:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1786400889.692196:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+19:5785:x1873176872146816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1786400889.693922:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+19:5785:x1873176872146816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1721us (3106us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400889.693935:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1786400889.694049:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc9269500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872146816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786400889.694163:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872146944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786400889.694219:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400889.694258:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffde179c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786400889.694389:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872146944 00000100:00100000:3.0:1786400889.694395:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872146944 00000100:00100000:3.0:1786400889.694746:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1786400889.694758:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+19:5785:x1873176872146944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786400889.694972:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+19:5785:x1873176872146944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 216us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400889.694979:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1786400889.695136:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:97b0324f-e214-4822-8711-e150ddac2a7e:5785:1873176872146944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786400889.695958:0:11545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd002680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:11545:1873176872147072:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786400889.696005:0:11545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400889.696045:0:11545:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc5455900 going to sleep for 11 seconds 00000100:00100000:3.0:1786400889.696048:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872147072 00000100:00100000:3.0:1786400889.696053:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872147072 00000100:00100000:3.0:1786400889.696131:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1786400889.696146:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+19:11545:x1873176872147072:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786400889.696335:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+19:11545:x1873176872147072:12345-0@lo:502:llog_process_th.0 Request processed in 189us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400889.696343:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1786400889.696431:0:11545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd002680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:11545:1873176872147072:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1786400889.696453:0:11545:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786400889.696463:0:11545:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786400889.696465:0:11545:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1786400889.696475:0:11545:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d6fc307d800 00000020:00000080:0.0:1786400889.696478:0:11545:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1786400889.697261:0:11545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:11545:1873176872147200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786400889.697324:0:11545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400889.697355:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872147200 00000100:00100000:0.0:1786400889.697360:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872147200 00000100:00100000:0.0:1786400889.697389:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1786400889.697396:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+19:11545:x1873176872147200:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786400889.697554:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+19:11545:x1873176872147200:12345-0@lo:502:llog_process_th.0 Request processed in 157us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400889.697561:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1786400889.697601:0:11545:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffde17240 going to sleep for 11 seconds 00000100:00100000:0.0:1786400889.697615:0:11545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:97b0324f-e214-4822-8711-e150ddac2a7e:11545:1873176872147200:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1786400889.697636:0:11545:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786400889.697642:0:11545:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786400889.697644:0:11545:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1786400889.697651:0:11545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1786400889.698612:0:5785:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1786400889.698640:0:5785:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1786400889.698651:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38600/0x5ccaaf4f3cb1db08 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1db0f expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400889.698662:0:5785:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38600/0x5ccaaf4f3cb1db08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1db0f expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786400889.702032:0:11546:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1786400889.774786:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400889.776373:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400889.776478:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850093824 00000100:00100000:3.0:1786400889.776496:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850093824 00000100:00100000:3.0:1786400889.776628:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 264 00000100:00100000:3.0:1786400889.776642:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+11:5580:x1873176850093824:12345-192.168.204.8@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786400889.776665:0:5781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400889.776689:0:5781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe7d39800/0x5ccaaf4f3cb1db16 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bb34 expref: -99 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400889.776727:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe7d39800/0x5ccaaf4f3cb1db16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb34 expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400889.776740:0:5781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe7d39800/0x5ccaaf4f3cb1db16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb34 expref: 12 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400889.776751:0:5781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7d39800, rc 0) 00000100:00100000:3.0:1786400889.777308:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+12:5580:x1873176850093824:12345-192.168.204.8@tcp:101:ll_cfg_requeue.0 Request processed in 664us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400889.777320:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 264 00000100:00100000:2.0:1786400889.780315:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400889.780556:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850093952 00000100:00100000:0.0:1786400889.780565:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850093952 00000100:00100000:0.0:1786400889.780619:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 265 00000100:00100000:0.0:1786400889.780628:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+12:5580:x1873176850093952:12345-192.168.204.8@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786400889.780946:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+12:5580:x1873176850093952:12345-192.168.204.8@tcp:501:ll_cfg_requeue.0 Request processed in 318us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400889.780955:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 265 00000100:00100000:2.0:1786400889.784321:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400889.784458:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850094080 00000100:00100000:0.0:1786400889.784468:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850094080 00000100:00100000:0.0:1786400889.784560:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 266 00000100:00100000:0.0:1786400889.784571:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+12:5580:x1873176850094080:12345-192.168.204.8@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786400889.784794:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+12:5580:x1873176850094080:12345-192.168.204.8@tcp:503:ll_cfg_requeue.0 Request processed in 224us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400889.784803:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 266 00000100:00100000:1.0:1786400889.800157:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400889.801331:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850094208 00000100:00100000:3.0:1786400889.801343:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850094208 00000100:00100000:3.0:1786400889.801406:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 267 00000100:00100000:3.0:1786400889.801417:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+12:9945:x1873176850094208:12345-192.168.204.8@tcp:502:llog_process_th.0 00000100:00100000:3.0:1786400889.802122:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+12:9945:x1873176850094208:12345-192.168.204.8@tcp:502:llog_process_th.0 Request processed in 702us (1972us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400889.802132:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 267 00000100:00100000:2.0:1786400889.807233:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400889.807392:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850094336 00000100:00100000:0.0:1786400889.807402:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850094336 00000100:00100000:0.0:1786400889.807501:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 268 00000100:00100000:0.0:1786400889.807511:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+12:9945:x1873176850094336:12345-192.168.204.8@tcp:502:llog_process_th.0 00000100:00100000:0.0:1786400889.808255:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+12:9945:x1873176850094336:12345-192.168.204.8@tcp:502:llog_process_th.0 Request processed in 742us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400889.808265:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 268 00000100:00100000:0.0:1786400889.812260:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400889.813277:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850094464 00000100:00100000:2.0:1786400889.813289:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850094464 00000100:00100000:2.0:1786400889.813392:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 269 00000100:00100000:2.0:1786400889.813403:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+12:5580:x1873176850094464:12345-192.168.204.8@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786400889.813420:0:5780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400889.813441:0:5780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fc4e5de00/0x5ccaaf4f3cb1db1d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bb3b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400889.813472:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc4e5de00/0x5ccaaf4f3cb1db1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb3b expref: 13 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400889.813504:0:5780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fc4e5de00/0x5ccaaf4f3cb1db1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb3b expref: 13 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400889.813525:0:5780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc4e5de00, rc 0) 00000100:00100000:2.0:1786400889.813591:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:5580:x1873176850094464:12345-192.168.204.8@tcp:101:ll_cfg_requeue.0 Request processed in 190us (1341us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400889.813599:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 269 00000100:00100000:1.0:1786400889.817484:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400889.817930:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850094592 00000100:00100000:0.0:1786400889.817941:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850094592 00000100:00100000:0.0:1786400889.819151:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 270 00000100:00100000:0.0:1786400889.819169:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:5580:x1873176850094592:12345-192.168.204.8@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786400889.819505:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:5580:x1873176850094592:12345-192.168.204.8@tcp:501:ll_cfg_requeue.0 Request processed in 342us (2030us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400889.819514:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 270 00000100:00100000:1.0:1786400889.825465:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400889.825665:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850094720 00000100:00100000:2.0:1786400889.825675:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850094720 00000100:00100000:2.0:1786400889.825733:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 271 00000100:00100000:2.0:1786400889.825743:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:5580:x1873176850094720:12345-192.168.204.8@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786400889.825972:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:5580:x1873176850094720:12345-192.168.204.8@tcp:503:ll_cfg_requeue.0 Request processed in 229us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400889.825981:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 271 00000100:00100000:2.0:1786400889.831952:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400889.832382:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850094848 00000100:00100000:0.0:1786400889.832395:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850094848 00000100:00100000:0.0:1786400889.832524:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 272 00000100:00100000:0.0:1786400889.832536:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:9947:x1873176850094848:12345-192.168.204.8@tcp:502:llog_process_th.0 00000100:00100000:0.0:1786400889.832785:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:9947:x1873176850094848:12345-192.168.204.8@tcp:502:llog_process_th.0 Request processed in 250us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400889.832794:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 272 00000100:00100000:1.0:1786400889.837599:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400889.837990:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850094976 00000100:00100000:3.0:1786400889.838001:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850094976 00000100:00100000:2.0:1786400889.838403:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 273 00000100:00100000:2.0:1786400889.838416:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:9947:x1873176850094976:12345-192.168.204.8@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786400889.838742:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:9947:x1873176850094976:12345-192.168.204.8@tcp:502:llog_process_th.0 Request processed in 327us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400889.838752:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 273 00000040:00080000:1.0:1786400890.734860:0:11546:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1786400890.798481:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400891.822554:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1786400892.214668:0:7501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:1.0:1786400892.849208:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400893.678359:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc34c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872147328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786400893.678432:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400893.678629:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872147328 00000100:00100000:0.0:1786400893.678638:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872147328 00000100:00100000:0.0:1786400893.678704:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1786400893.678712:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc926aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872147328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786400893.678753:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1786400893.678875:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786400893.678943:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc926aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872147328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 231us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400893.678951:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1786400893.679073:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fc34c1880 x1873176872147328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400909 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400893.679114:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc34c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872147328:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1786400893.870576:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400894.000416:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400894.000464:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400894.000499:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400894.000542:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400894.000577:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850095232 00000100:00100000:1.0:1786400894.000589:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850095232 00000100:00100000:1.0:1786400894.000648:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850095488 00000100:00100000:1.0:1786400894.000651:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850095488 00000100:00100000:1.0:1786400894.000675:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 104 00000100:00100000:1.0:1786400894.000685:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc34c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+5:2364:x1873176850095232:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:1.0:1786400894.000758:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc34c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+5:2364:x1873176850095232:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 74us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400894.000766:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 104 00000100:00100000:1.0:1786400894.000785:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 105 00000100:00100000:1.0:1786400894.000792:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc34c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2364:x1873176850095488:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:1.0:1786400894.000816:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc34c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2364:x1873176850095488:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 26us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400894.000823:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 105 00000100:00080000:1.0:1786400894.000908:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400894.001214:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850095104 00000100:00100000:0.0:1786400894.001219:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850095104 00000100:00100000:0.0:1786400894.001257:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 274 00000100:00100000:0.0:1786400894.001264:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2365:x1873176850095104:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786400894.001295:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2365:x1873176850095104:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 33us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400894.001301:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 274 00000100:00100000:2.0:1786400894.001618:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850095360 00000100:00100000:2.0:1786400894.001623:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850095360 00000100:00100000:2.0:1786400894.001674:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 42 00000100:00100000:2.0:1786400894.001682:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc34c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+5:2365:x1873176850095360:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:2.0:1786400894.001719:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc34c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+5:2365:x1873176850095360:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 39us (1220us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400894.001725:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 42 00000100:00080000:0.0:1786400894.002791:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786400894.190658:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873176872147584:0@lo:400:kworker.0 00000100:00100000:0.0:1786400894.190727:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400894.190790:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1786400894.190797:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:97b0324f-e214-4822-8711-e150ddac2a7e:3307:1873176872147456:0@lo:400:kworker.0 00000100:00100000:0.0:1786400894.190841:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400894.190861:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872147968:0@lo:400:kworker.0 00000100:00100000:0.0:1786400894.190885:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400894.190913:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872147968 00000100:00100000:0.0:1786400894.190922:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872147968 00000100:00100000:0.0:1786400894.190970:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1786400894.190980:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee30ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872147968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400894.191043:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee30ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872147968:12345-0@lo:400:kworker.0 Request processed in 64us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400894.191051:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1786400894.191074:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873176872147712:0@lo:400:kworker.0 00000100:00100000:0.0:1786400894.191126:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400894.191143:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786400894.191148:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee30df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873176872147840:0@lo:400:kworker.0 00000100:00100000:0.0:1786400894.191167:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400894.191198:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872147584 00000100:00100000:0.0:1786400894.191201:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872147584 00000100:00100000:0.0:1786400894.191223:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872147712 00000100:00100000:0.0:1786400894.191226:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872147712 00000100:00100000:0.0:1786400894.191240:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872147840 00000100:00100000:0.0:1786400894.191243:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872147840 00000100:00100000:0.0:1786400894.191257:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1786400894.191262:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee30d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873176872147584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400894.191306:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee30d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873176872147584:12345-0@lo:400:kworker.0 Request processed in 44us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400894.191313:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1786400894.191326:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1786400894.191332:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee353100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873176872147712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400894.191364:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee353100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873176872147712:12345-0@lo:400:kworker.0 Request processed in 32us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400894.191370:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1786400894.191380:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1786400894.191387:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee351880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873176872147840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400894.191410:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee351880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873176872147840:12345-0@lo:400:kworker.0 Request processed in 25us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400894.191415:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:0.0:1786400894.191430:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786400894.191434:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786400894.191459:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873176872147840:0@lo:400:kworker.0 00000100:00100000:0.0:1786400894.191467:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873176872147712:0@lo:400:kworker.0 00000100:00100000:0.0:1786400894.191500:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1786400894.191506:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d6ff692e300, transno 4294967300 00000100:00100000:0.0:1786400894.191514:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee30dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872147968:0@lo:400:kworker.0 00000100:00100000:0.0:1786400894.191524:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873176872147584:0@lo:400:kworker.0 00000100:00100000:3.0:1786400894.192626:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786400894.192646:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc34c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872148096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786400894.192697:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400894.192777:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872148096 00000100:00100000:3.0:1786400894.192783:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872148096 00000100:00100000:3.0:1786400894.193459:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1786400894.193471:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9268a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872148096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786400894.193514:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786400894.193565:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9268a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872148096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400894.193572:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1786400894.193617:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc34c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872148096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786400894.194080:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872147456 00000100:00100000:2.0:1786400894.194291:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872147456 00000100:00100000:2.0:1786400894.194329:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1786400894.194342:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc33f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+19:3307:x1873176872147456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400894.194388:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc33f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+19:3307:x1873176872147456:12345-0@lo:400:kworker.0 Request processed in 52us (3547us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400894.194394:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1786400894.196460:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:97b0324f-e214-4822-8711-e150ddac2a7e:3307:1873176872147456:0@lo:400:kworker.0 00010000:00010000:1.0:1786400894.894343:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400895.918605:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400896.942287:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400897.967062:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400898.799184:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc34c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872148224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786400898.799277:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400898.799541:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872148224 00000100:00100000:3.0:1786400898.799550:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872148224 00000100:00100000:3.0:1786400898.799620:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1786400898.799631:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872148224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786400898.799669:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1786400898.799980:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786400898.800513:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872148224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 881us (1232us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400898.800522:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1786400898.801210:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fc34c0000 x1873176872148224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400914 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400898.801233:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc34c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872148224:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786400898.990256:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400899.120565:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400899.120739:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400899.121182:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400899.121225:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400899.121648:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850095616 00000100:00100000:2.0:1786400899.121658:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850095616 00000100:00100000:2.0:1786400899.121708:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 276 00000100:00100000:2.0:1786400899.121717:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2364:x1873176850095616:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:2.0:1786400899.121792:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2364:x1873176850095616:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 76us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400899.121800:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 276 00000100:00100000:2.0:1786400899.121861:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850095872 00000100:00100000:2.0:1786400899.121865:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850095872 00000100:00100000:2.0:1786400899.121924:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 44 00000100:00100000:2.0:1786400899.121932:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc34c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+5:2364:x1873176850095872:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:2.0:1786400899.121961:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc34c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+5:2364:x1873176850095872:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 31us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400899.121968:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 44 00000100:00100000:0.0:1786400899.123012:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850095744 00000100:00100000:0.0:1786400899.123021:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850095744 00000100:00100000:0.0:1786400899.123083:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850096000 00000100:00100000:0.0:1786400899.123103:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850096000 00000100:00100000:0.0:1786400899.123136:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 109 00000100:00100000:0.0:1786400899.123144:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc34c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+5:2364:x1873176850095744:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786400899.123201:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc34c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+5:2364:x1873176850095744:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 57us (2651us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400899.123208:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 109 00000100:00100000:0.0:1786400899.123224:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 110 00000100:00100000:0.0:1786400899.123230:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc34c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2364:x1873176850096000:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786400899.123254:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc34c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2364:x1873176850096000:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 24us (2516us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400899.123260:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 110 00000100:00080000:1.0:1786400899.124665:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786400899.124674:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786400899.310450:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee352680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872148480:0@lo:400:kworker.0 00000100:00100000:0.0:1786400899.310533:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400899.310595:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786400899.310601:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee352a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872148608:0@lo:400:kworker.0 00000100:00100000:0.0:1786400899.310624:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400899.310660:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872148480 00000100:00100000:0.0:1786400899.310668:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872148480 00000100:00100000:0.0:1786400899.310719:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872148608 00000100:00100000:0.0:1786400899.310722:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872148608 00000100:00100000:0.0:1786400899.310752:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1786400899.310760:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872148480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400899.310809:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872148480:12345-0@lo:400:kworker.0 Request processed in 49us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400899.310816:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1786400899.310834:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1786400899.310840:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872148608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400899.310866:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872148608:12345-0@lo:400:kworker.0 Request processed in 26us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400899.310872:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:0.0:1786400899.310888:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400899.310951:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee352a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872148608:0@lo:400:kworker.0 00000100:00100000:0.0:1786400899.310962:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee352680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872148480:0@lo:400:kworker.0 00000100:00100000:1.0:1786400899.311620:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee350700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873176872148736:0@lo:400:kworker.0 00000100:00100000:1.0:1786400899.311658:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400899.311688:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1786400899.311695:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872148352:0@lo:400:kworker.0 00000100:00100000:1.0:1786400899.311732:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400899.311757:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee352d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872148864:0@lo:400:kworker.0 00000100:00100000:1.0:1786400899.311782:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400899.311805:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872148352 00000100:00100000:1.0:1786400899.311810:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872148352 00000100:00100000:1.0:1786400899.311840:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1786400899.311847:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+19:3308:x1873176872148352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400899.311885:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+19:3308:x1873176872148352:12345-0@lo:400:kworker.0 Request processed in 38us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400899.311891:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1786400899.311940:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872148352:0@lo:400:kworker.0 00000100:00100000:2.0:1786400899.312108:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872148736 00000100:00100000:2.0:1786400899.312121:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872148736 00000100:00100000:2.0:1786400899.312164:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1786400899.312171:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc34c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873176872148736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400899.312211:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc34c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873176872148736:12345-0@lo:400:kworker.0 Request processed in 41us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400899.312217:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1786400899.312255:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee350700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873176872148736:0@lo:400:kworker.0 00000100:00080000:1.0:1786400899.312542:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400899.314267:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872148864 00000100:00100000:3.0:1786400899.314279:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872148864 00000100:00100000:3.0:1786400899.314388:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1786400899.314397:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc34c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872148864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400899.314478:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc34c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872148864:12345-0@lo:400:kworker.0 Request processed in 82us (2694us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400899.314498:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1786400899.314556:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee352d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872148864:0@lo:400:kworker.0 00000100:00100000:0.0:1786400899.314661:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786400899.314674:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872148992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786400899.314711:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400899.314748:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872148992 00000100:00100000:0.0:1786400899.314752:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872148992 00000100:00100000:0.0:1786400899.314780:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1786400899.314786:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee352d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872148992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786400899.314811:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786400899.314847:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee352d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872148992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400899.314853:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1786400899.314896:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872148992:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1786400899.316859:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1786400900.014295:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786400900.975155:0:11546:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1786400901.038978:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400902.062412:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400903.086383:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400903.918579:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc34c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872149120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786400903.919377:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400903.919880:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872149120 00000100:00100000:2.0:1786400903.919890:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872149120 00000100:00100000:2.0:1786400903.919959:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1786400903.919969:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee350700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872149120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786400903.920007:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400903.920060:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee350700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872149120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400903.920068:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1786400903.920789:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fc34c1880 x1873176872149120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400919 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400903.920834:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc34c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872149120:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1786400903.920909:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786400904.110453:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400904.248255:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400904.248306:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400904.248850:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850096128 00000100:00100000:2.0:1786400904.248861:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850096128 00000100:00100000:2.0:1786400904.248918:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 278 00000100:00100000:2.0:1786400904.248929:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2365:x1873176850096128:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:2.0:1786400904.249015:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2365:x1873176850096128:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 87us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400904.249024:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 278 00000100:00100000:3.0:1786400904.249216:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850096256 00000100:00100000:3.0:1786400904.249221:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850096256 00000100:00100000:3.0:1786400904.249273:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 114 00000100:00100000:3.0:1786400904.249282:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc34c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+5:2365:x1873176850096256:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:3.0:1786400904.249316:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc34c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+5:2365:x1873176850096256:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 36us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400904.249322:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 114 00000100:00080000:1.0:1786400904.250011:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400904.270464:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400904.271084:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400904.271265:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850096384 00000100:00100000:2.0:1786400904.271275:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850096384 00000100:00100000:2.0:1786400904.271346:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 19 00000100:00100000:2.0:1786400904.271358:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc34c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+5:2361:x1873176850096384:12345-192.168.204.8@tcp:9:kworker.0 00000020:00000080:2.0:1786400904.271678:0:6593:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5ccaaf4f3cb1da59 00000100:00080000:2.0:1786400904.271689:0:6593:0:(import.c:65:import_set_state_nolock()) ffff9d6ffd55b000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1786400904.271816:0:6593:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1786400904.272923:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850096512 00000100:00100000:0.0:1786400904.272933:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850096512 00000100:00100000:0.0:1786400904.272988:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 115 00000100:00100000:0.0:1786400904.272998:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc34c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2365:x1873176850096512:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786400904.273076:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc34c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2365:x1873176850096512:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 80us (1993us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400904.273114:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 115 00000100:00100000:2.0:1786400904.273870:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc34c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+2:2361:x1873176850096384:12345-192.168.204.8@tcp:9:kworker.0 Request processed in 2503us (3404us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400904.273880:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 19 00010000:00010000:2.0:1786400904.273909:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1786400904.274076:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786400904.274082:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786400904.430571:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd000e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:97b0324f-e214-4822-8711-e150ddac2a7e:3309:1873176872149376:0@lo:400:kworker.0 00000100:00100000:1.0:1786400904.430642:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400904.430688:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd001500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872149888:0@lo:400:kworker.0 00000100:00100000:1.0:1786400904.430715:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400904.430739:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1786400904.430745:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872149248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786400904.430767:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400904.430784:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd002a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873176872149760:0@lo:400:kworker.0 00000100:00100000:1.0:1786400904.430817:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400904.430846:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872149376 00000100:00100000:1.0:1786400904.430853:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872149376 00000100:00100000:1.0:1786400904.430894:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1786400904.430903:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+19:3309:x1873176872149376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400904.430950:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+19:3309:x1873176872149376:12345-0@lo:400:kworker.0 Request processed in 48us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400904.430970:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1786400904.431003:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872149248 00000100:00100000:1.0:1786400904.431007:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872149248 00000100:00100000:1.0:1786400904.431039:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1786400904.431045:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc34c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872149248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786400904.431083:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400904.431133:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc34c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872149248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400904.431139:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1786400904.431161:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786400904.431191:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872149248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786400904.431200:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd000e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:97b0324f-e214-4822-8711-e150ddac2a7e:3309:1873176872149376:0@lo:400:kworker.0 00000100:00100000:0.0:1786400904.431506:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd002d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872149504:0@lo:400:kworker.0 00000100:00100000:0.0:1786400904.431536:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400904.431565:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786400904.431570:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd002680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872149632:0@lo:400:kworker.0 00000100:00100000:0.0:1786400904.431591:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400904.431615:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872149760 00000100:00100000:0.0:1786400904.431619:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872149760 00000100:00100000:0.0:1786400904.431651:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872149504 00000100:00100000:0.0:1786400904.431654:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872149504 00000100:00100000:0.0:1786400904.431667:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872149632 00000100:00100000:0.0:1786400904.431669:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872149632 00000100:00100000:0.0:1786400904.431684:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1786400904.431690:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc34c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873176872149760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400904.431728:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc34c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873176872149760:12345-0@lo:400:kworker.0 Request processed in 38us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400904.431735:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1786400904.431757:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1786400904.431762:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872149504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400904.431792:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872149504:12345-0@lo:400:kworker.0 Request processed in 30us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400904.431798:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1786400904.431823:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1786400904.431829:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee352a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872149632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400904.431855:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee352a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872149632:12345-0@lo:400:kworker.0 Request processed in 27us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400904.431861:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:0.0:1786400904.431876:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786400904.435002:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd002680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872149632:0@lo:400:kworker.0 00000100:00100000:2.0:1786400904.435020:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd002d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872149504:0@lo:400:kworker.0 00000100:00100000:3.0:1786400904.435164:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872149888 00000100:00100000:3.0:1786400904.435173:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872149888 00000100:00100000:3.0:1786400904.435219:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1786400904.435228:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc34c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872149888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400904.435303:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc34c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872149888:12345-0@lo:400:kworker.0 Request processed in 76us (4586us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400904.435310:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1786400904.435890:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd002a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873176872149760:0@lo:400:kworker.0 00000100:00100000:0.0:1786400904.435914:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd001500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872149888:0@lo:400:kworker.0 00010000:00010000:3.0:1786400905.134323:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400906.159004:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400907.182661:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1786400907.550041:0:7501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 096c63d9-38b8-441b-8c71-343db25fe88a 00000020:00000080:2.0:1786400907.550050:0:7501:0:(genops.c:906:class_export_put()) final put ffff9d6ffd55d800/096c63d9-38b8-441b-8c71-343db25fe88a 00000020:00000080:3.0:1786400907.550144:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ffd55d800/096c63d9-38b8-441b-8c71-343db25fe88a for lustre-OST0001 00000020:00000080:3.0:1786400907.550197:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ffd55b000 for lustre-OST0001 00010000:00010000:2.0:1786400908.206270:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400909.039444:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc34c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872150016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786400909.039519:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400909.039593:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872150016 00000100:00100000:1.0:1786400909.039601:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872150016 00000100:00100000:1.0:1786400909.039664:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1786400909.039674:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff69b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872150016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786400909.039721:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400909.039771:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff69b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872150016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400909.039778:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1786400909.039822:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fc34c1880 x1873176872150016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400909.039842:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc34c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872150016:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1786400909.039877:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786400909.230376:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400909.360570:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400909.360606:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400909.361762:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400909.361809:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850096768 00000100:00100000:0.0:1786400909.361821:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850096768 00000100:00100000:0.0:1786400909.361892:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850096896 00000100:00100000:0.0:1786400909.361896:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850096896 00000100:00100000:0.0:1786400909.362810:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 119 00000100:00100000:0.0:1786400909.362824:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee352300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+5:2365:x1873176850096768:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:3.0:1786400909.363223:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 120 00000100:00100000:3.0:1786400909.363239:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2365:x1873176850096896:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786400909.363752:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee352300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+5:2365:x1873176850096768:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 928us (3188us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400909.363763:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 119 00000100:00100000:0.0:1786400909.363794:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850096640 00000100:00100000:0.0:1786400909.363815:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850096640 00000100:00100000:0.0:1786400909.363848:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 280 00000100:00100000:0.0:1786400909.363855:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2365:x1873176850096640:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786400909.365971:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2365:x1873176850096640:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 2104us (5352us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400909.365978:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2365:x1873176850096896:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 2726us (4204us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400909.365988:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 280 00000100:00100000:3.0:1786400909.366006:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 120 00000100:00080000:0.0:1786400909.366038:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400909.550352:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786400909.550383:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff69b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872150144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786400909.550621:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400909.550720:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872150144 00000100:00100000:1.0:1786400909.550729:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872150144 00000100:00100000:1.0:1786400909.550804:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1786400909.550814:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc34c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872150144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786400909.550862:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400909.550913:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc34c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872150144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400909.550921:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1786400909.551855:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc9269500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872150272:0@lo:400:kworker.0 00000100:00100000:3.0:1786400909.551915:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1786400909.552046:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786400909.552072:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872150272 00000100:00100000:1.0:1786400909.552080:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872150272 00000100:00100000:1.0:1786400909.552143:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1786400909.552153:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+19:3308:x1873176872150272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400909.552199:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+19:3308:x1873176872150272:12345-0@lo:400:kworker.0 Request processed in 47us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400909.552206:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1786400909.552246:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872150528:0@lo:400:kworker.0 00000100:00100000:1.0:1786400909.552276:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400909.552308:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872150528 00000100:00100000:1.0:1786400909.552312:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872150528 00000100:00100000:1.0:1786400909.552350:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1786400909.552357:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872150528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400909.552395:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872150528:12345-0@lo:400:kworker.0 Request processed in 38us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400909.552402:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1786400909.552628:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc9269500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872150272:0@lo:400:kworker.0 00000100:00100000:3.0:1786400909.552653:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786400909.552660:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873176872150400:0@lo:400:kworker.0 00000100:00100000:3.0:1786400909.552687:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400909.553584:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1873176872150656:0@lo:400:kworker.0 00000100:00100000:3.0:1786400909.553629:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400909.553665:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872150400 00000100:00100000:3.0:1786400909.553672:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872150400 00000100:00080000:1.0:1786400909.554463:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400909.554583:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872150656 00000100:00100000:3.0:1786400909.554590:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872150656 00000100:00080000:1.0:1786400909.556371:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786400909.564166:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1786400909.564203:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873176872150400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400909.564354:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873176872150400:12345-0@lo:400:kworker.0 Request processed in 172us (11665us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400909.564362:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1786400909.564399:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1786400909.564406:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1873176872150656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400909.564459:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1873176872150656:12345-0@lo:400:kworker.0 Request processed in 53us (10830us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400909.564465:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1786400909.568714:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872150528:0@lo:400:kworker.0 00000100:00100000:1.0:1786400909.568755:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff69b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872150144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786400909.568825:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873176872150400:0@lo:400:kworker.0 00000100:00100000:1.0:1786400909.568850:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1873176872150656:0@lo:400:kworker.0 00000040:00080000:2.0:1786400910.192072:0:11546:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1786400910.259275:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400911.278800:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786400912.244470:0:11707:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 18:28:29 (1786400909) 00010000:00010000:2.0:1786400912.304386:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400913.326402:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400913.665050:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400913.665635:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850097024 00000100:00100000:3.0:1786400913.665646:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850097024 00000100:00100000:3.0:1786400913.665729:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 32 00000100:00100000:3.0:1786400913.665745:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee30dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+5:10218:x1873176850097024:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786400913.665767:0:6615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400913.665789:0:6615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1db24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bb42 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400913.665855:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1db2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400913.665884:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1db2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400913.665898:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1db2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400913.666117:0:6615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1786400913.666122:0:6615:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1786400913.666226:0:6615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1db2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400913.666271:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1db24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb42 expref: 7 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400913.666290:0:6615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1db2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb42 expref: 6 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400913.666298:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fc5599200) 00010000:00010000:3.0:1786400913.666301:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786400913.666316:0:6615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7d38400, rc 0) 00000100:00100000:3.0:1786400913.666402:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee30dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+6:10218:x1873176850097024:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 663us (1361us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400913.666411:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 32 00000100:00080000:1.0:1786400913.666972:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400913.676137:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400913.676897:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850097152 00000100:00100000:1.0:1786400913.676911:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850097152 00000100:00100000:1.0:1786400913.677159:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 33 00000100:00100000:1.0:1786400913.677172:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee30c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+6:10219:x1873176850097152:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786400913.677196:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400913.677218:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1db32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bb49 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400913.677299:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1db39 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400913.677322:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1db39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400913.677333:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1db39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400913.677347:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1db40 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400913.677353:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1db40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400913.677360:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1db40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400913.677991:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f000/0x5ccaaf4f3cb1db47 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400913.678002:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f000/0x5ccaaf4f3cb1db47 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400913.678010:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f000/0x5ccaaf4f3cb1db47 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400913.678136:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1786400913.678141:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1786400913.678232:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f000/0x5ccaaf4f3cb1db47 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400913.678255:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1db39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400913.678262:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1db39 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400913.678269:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1db39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400913.678275:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138f200 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400913.678279:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1db39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400913.678287:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1db39 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400913.678299:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fc5599200) 00010000:00010000:1.0:1786400913.678428:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400913.678435:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1db39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400913.678441:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1db39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400913.678454:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1db40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400913.678459:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1db40 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400913.678464:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1db40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400913.678469:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138fa00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400913.678471:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1db40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400913.678476:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1db40 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400913.678484:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9d6fe06cb800) 00010000:00010000:1.0:1786400913.678486:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400913.678489:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1db40 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400913.678494:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1db40 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400913.678666:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1db32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb49 expref: 8 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400913.678693:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f000/0x5ccaaf4f3cb1db47 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb49 expref: 7 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400913.678699:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d6fe06cb400) 00010000:00010000:1.0:1786400913.678702:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786400913.678704:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138f000, rc 0) 00000100:00100000:1.0:1786400913.678880:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee30c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+7:10219:x1873176850097152:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 1709us (2753us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400913.678888:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 33 00000100:00100000:2.0:1786400913.690728:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400913.690897:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850097408 00000100:00100000:3.0:1786400913.690908:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850097408 00000100:00100000:3.0:1786400913.690990:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 34 00000100:00100000:3.0:1786400913.691000:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+7:10219:x1873176850097408:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786400913.691023:0:6615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400913.691060:0:6615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1db4e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bb50 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400913.691184:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1db55 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400913.691198:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1db55 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400913.691209:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1db55 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400913.691252:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1db5c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400913.691260:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1db5c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400913.691266:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1db5c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400913.694698:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39200/0x5ccaaf4f3cb1db63 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400913.694724:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39200/0x5ccaaf4f3cb1db63 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400913.694737:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39200/0x5ccaaf4f3cb1db63 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400913.694752:0:6615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1786400913.696541:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1db55 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400913.696570:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1db55 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400913.696578:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1db55 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400913.696584:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7d38000 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786400913.696589:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1db55 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400913.696598:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1db55 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400913.696615:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d6fe06cb400) 00010000:00010000:3.0:1786400913.696627:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400913.696631:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1db55 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400913.696638:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1db55 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400913.696654:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1db5c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400913.696660:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1db5c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400913.696666:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1db5c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400913.696672:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7d38e00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786400913.696680:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1db5c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400913.696686:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1db5c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400913.696695:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9d6fc5599e00) 00010000:00010000:3.0:1786400913.696698:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400913.696701:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1db5c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400913.696707:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1db5c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400913.699829:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1db4e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb50 expref: 10 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400913.699865:0:6615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39200/0x5ccaaf4f3cb1db63 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb50 expref: 9 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400913.699874:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d6fc5599600) 00010000:00010000:3.0:1786400913.699877:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400913.699880:0:6615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7d39200, rc 0) 00000100:00100000:3.0:1786400913.699960:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+9:10219:x1873176850097408:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 8960us (9240us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1786400913.699970:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 34 00000100:00100000:0.0:1786400913.714417:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400913.714663:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850097536 00000100:00100000:3.0:1786400913.714682:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850097536 00000100:00100000:3.0:1786400913.714833:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 35 00000100:00100000:3.0:1786400913.714847:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee30df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+9:10219:x1873176850097536:12345-192.168.204.8@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1786400913.715007:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee30df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+9:10219:x1873176850097536:12345-192.168.204.8@tcp:59:lhsmtool_posix.0 Request processed in 162us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400913.715015:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 35 00000100:00100000:3.0:1786400914.158460:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872150784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786400914.158532:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400914.158600:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872150784 00000100:00100000:3.0:1786400914.158618:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872150784 00000100:00100000:3.0:1786400914.158673:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1786400914.158685:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872150784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786400914.158718:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786400914.158761:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872150784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400914.158767:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1786400914.158787:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1786400914.158813:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ffd573b80 x1873176872150784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786400930 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400914.158832:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872150784:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1786400914.286700:0:11546:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1786400914.351775:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400914.486568:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400914.486639:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400914.486645:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850097664 00000100:00100000:2.0:1786400914.486658:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850097664 00000100:00100000:1.0:1786400914.486690:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400914.486803:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 282 00000100:00100000:0.0:1786400914.486809:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850097792 00000100:00100000:0.0:1786400914.486816:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850097792 00000100:00100000:2.0:1786400914.486817:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2364:x1873176850097664:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786400914.486861:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850097920 00000100:00100000:0.0:1786400914.486866:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850097920 00000100:00100000:0.0:1786400914.486905:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 124 00000100:00100000:2.0:1786400914.486913:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2364:x1873176850097664:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 100us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400914.486916:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+9:2365:x1873176850097792:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:2.0:1786400914.486927:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 282 00000100:00080000:1.0:1786400914.487131:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400914.487148:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 125 00000100:00100000:1.0:1786400914.487157:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2363:x1873176850097920:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786400914.487322:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+9:2365:x1873176850097792:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 407us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400914.487331:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 124 00000100:00100000:1.0:1786400914.487800:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2363:x1873176850097920:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 642us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400914.487808:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 125 00000100:00100000:2.0:1786400914.671310:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd003b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872151296:0@lo:400:kworker.0 00000100:00100000:2.0:1786400914.671429:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400914.671507:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1786400914.671515:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd002680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872150912:0@lo:400:kworker.0 00000100:00100000:2.0:1786400914.671552:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400914.671576:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd001500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873176872151424:0@lo:400:kworker.0 00000100:00100000:2.0:1786400914.671645:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400914.671702:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872151296 00000100:00100000:2.0:1786400914.671711:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872151296 00000100:00100000:2.0:1786400914.671776:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1786400914.671788:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd000e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872151296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400914.672472:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd000000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872151040:0@lo:400:kworker.0 00000100:00100000:1.0:1786400914.672514:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400914.672540:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd002a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872151552:0@lo:400:kworker.0 00000100:00100000:1.0:1786400914.672582:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400914.672620:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786400914.672627:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd001f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872151168:0@lo:400:kworker.0 00000100:00100000:1.0:1786400914.672658:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400914.672745:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872150912 00000100:00100000:1.0:1786400914.672750:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872150912 00000100:00100000:1.0:1786400914.672791:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1786400914.672799:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+19:3308:x1873176872150912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400914.672837:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+19:3308:x1873176872150912:12345-0@lo:400:kworker.0 Request processed in 39us (1284us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400914.672846:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1786400914.672937:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872151424 00000100:00100000:1.0:1786400914.672941:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872151424 00000100:00100000:1.0:1786400914.672977:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872151040 00000100:00100000:1.0:1786400914.672981:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872151040 00000100:00100000:1.0:1786400914.672993:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872151168 00000100:00100000:1.0:1786400914.672995:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872151168 00000100:00100000:1.0:1786400914.673011:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1786400914.673018:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fe9204700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873176872151424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400914.673050:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fe9204700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873176872151424:12345-0@lo:400:kworker.0 Request processed in 33us (1406us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400914.673056:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1786400914.673067:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1786400914.673072:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff69b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872151040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400914.673080:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd000e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872151296:12345-0@lo:400:kworker.0 Request processed in 1000us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400914.673118:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff69b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872151040:12345-0@lo:400:kworker.0 Request processed in 45us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400914.673125:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1786400914.673136:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1786400914.673142:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872151168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400914.673167:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872151168:12345-0@lo:400:kworker.0 Request processed in 26us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400914.673180:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1786400914.673201:0:6592:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1786400914.673209:0:6592:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1786400914.673232:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1786400914.673253:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872151552 00000100:00100000:2.0:1786400914.673257:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872151552 00000100:00100000:2.0:1786400914.673277:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1786400914.673291:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6083100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872151552:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1786400914.673335:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786400914.673342:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786400914.673456:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6083100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872151552:12345-0@lo:400:kworker.0 Request processed in 165us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400914.673462:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc6081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872151680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786400914.673468:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1786400914.673503:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400914.673532:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd002680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872150912:0@lo:400:kworker.0 00000100:00100000:1.0:1786400914.673544:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872151680 00000100:00100000:1.0:1786400914.673550:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872151680 00000100:00100000:2.0:1786400914.673556:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd001500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873176872151424:0@lo:400:kworker.0 00010000:00080000:2.0:1786400914.673577:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ffd003b80 x1873176872151296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1786400930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786400914.673583:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1786400914.673596:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd003b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872151296:0@lo:400:kworker.0 00000100:00100000:1.0:1786400914.673606:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6080a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872151680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786400914.673646:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400914.673685:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6080a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872151680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400914.673692:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1786400914.674174:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc6081c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872151680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786400914.674757:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd001f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872151168:0@lo:400:kworker.0 00000100:00100000:2.0:1786400914.674774:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd000000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872151040:0@lo:400:kworker.0 00000100:00100000:2.0:1786400914.674786:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd002a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872151552:0@lo:400:kworker.0 00000100:00100000:1.0:1786400915.364907:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400915.364969:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850098048 00000100:00100000:0.0:1786400915.364982:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850098048 00000100:00100000:0.0:1786400915.365069:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 36 00000100:00100000:0.0:1786400915.365080:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+9:10261:x1873176850098048:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:0.0:1786400915.365127:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400915.365153:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1db71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bb57 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400915.365246:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1db78 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400915.365262:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1db78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400915.365277:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1db78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400915.365292:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1db7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400915.365300:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1db7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400915.365307:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1db7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1786400915.365523:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786400915.365577:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1db78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400915.365602:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1db78 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400915.365609:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1db78 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400915.365616:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aaa00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400915.365620:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1db78 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400915.365638:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1db78 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400915.365651:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fc5599200) 00010000:00010000:0.0:1786400915.365654:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400915.365659:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1db78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400915.365666:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1db78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400915.365677:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1db7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400915.365683:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1db7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400915.365688:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1db7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400915.365693:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aa200 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400915.365696:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1db7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400915.365702:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1db7f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400915.365708:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9d6fc90cd300) 00010000:00010000:0.0:1786400915.365711:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400915.365713:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1db7f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400915.365729:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1db7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400915.365763:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1db71 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb57 expref: 10 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400915.365774:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fc5599200) 00010000:00010000:0.0:1786400915.365776:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400915.365780:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1db71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb57 expref: 10 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400915.365790:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5ab400, rc 0) 00000100:00100000:0.0:1786400915.367578:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+9:10261:x1873176850098048:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 2492us (2672us total) trans 0 rc 301/301 00000100:00100000:0.0:1786400915.367618:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 36 00010000:00010000:0.0:1786400915.374360:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400915.384568:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400915.385247:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850098304 00000100:00100000:1.0:1786400915.385259:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850098304 00000100:00100000:1.0:1786400915.385312:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 37 00000100:00100000:1.0:1786400915.385322:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd5b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+9:10261:x1873176850098304:12345-192.168.204.8@tcp:36:lfs.0 00010000:00010000:1.0:1786400915.385400:0:6615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400915.385428:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1db2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb42 expref: 9 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.385444:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fc5599200) 00010000:00010000:1.0:1786400915.385464:0:6615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786400915.385743:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1db86 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.385757:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1db86 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.385768:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1db86 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.385780:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1db8d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.385788:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1db8d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.385795:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1db8d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400915.388972:0:6615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1786400915.390095:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1db86 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.390110:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1db86 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.390117:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1db86 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.390123:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138e800 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400915.390127:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1db86 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.390144:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1db86 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.390161:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fe06cb800) 00010000:00010000:1.0:1786400915.390164:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400915.390168:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1db86 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.390174:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1db86 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786400915.390192:0:6615:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003dd4aeff reply state 000000005ccdef47 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1db8d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400915.390201:0:6615:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786400915.390592:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd5b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+10:10261:x1873176850098304:12345-192.168.204.8@tcp:36:lfs.0 Request processed in 5257us (6020us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1786400915.390602:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 37 00010000:00010000:1.0:1786400915.399577:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1db8d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.399609:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1db8d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.399617:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1db8d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.399622:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138ee00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400915.399627:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1db8d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.399646:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1db8d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.399666:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9d6fe06cb100) 00010000:00010000:1.0:1786400915.399669:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400915.399674:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1db8d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.399680:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1db8d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400915.476878:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400915.476958:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850098432 00000100:00100000:2.0:1786400915.476970:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850098432 00000100:00100000:2.0:1786400915.477038:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 38 00000100:00100000:2.0:1786400915.477049:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd5b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+9:10269:x1873176850098432:12345-192.168.204.8@tcp:101:lctl.0 00010000:00010000:2.0:1786400915.477073:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400915.477139:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1db94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bb5e expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.477210:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c800/0x5ccaaf4f3cb1db9b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.477236:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c800/0x5ccaaf4f3cb1db9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.477262:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c800/0x5ccaaf4f3cb1db9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400915.477327:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1786400915.477331:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1786400915.477374:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c800/0x5ccaaf4f3cb1db9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.477411:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1db94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb5e expref: 11 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.477430:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c800/0x5ccaaf4f3cb1db9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb5e expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.477439:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fd022e500) 00010000:00010000:2.0:1786400915.477443:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786400915.477446:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc4e5c800, rc 0) 00000100:00100000:2.0:1786400915.477496:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd5b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+10:10269:x1873176850098432:12345-192.168.204.8@tcp:101:lctl.0 Request processed in 449us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400915.477503:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 38 00000100:00100000:1.0:1786400915.532215:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400915.533139:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850098560 00000100:00100000:2.0:1786400915.533152:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850098560 00000100:00100000:2.0:1786400915.534005:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 39 00000100:00100000:2.0:1786400915.534025:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+10:10275:x1873176850098560:12345-192.168.204.8@tcp:101:bash.0 00010000:00010000:2.0:1786400915.534048:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400915.534071:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1dba2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bb65 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.534182:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1dba9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.534197:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1dba9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.534207:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1dba9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.534222:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dbb0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.534243:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dbb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.534250:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dbb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.534372:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5dc00/0x5ccaaf4f3cb1dbb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.534380:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5dc00/0x5ccaaf4f3cb1dbb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.534387:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5dc00/0x5ccaaf4f3cb1dbb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400915.534430:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1786400915.534435:0:5789:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786400915.534477:0:5789:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5dc00/0x5ccaaf4f3cb1dbb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.534500:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1dba9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.534506:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1dba9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.534512:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1dba9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.534517:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5d000 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400915.534521:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1dba9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.534529:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1dba9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.534541:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fd022e500) 00010000:00010000:2.0:1786400915.534544:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400915.534548:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1dba9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.534554:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1dba9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.534567:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dbb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.534572:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dbb0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.534577:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dbb0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.534601:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5c000 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400915.534604:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dbb0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.534611:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dbb0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.534618:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9d6fd022e300) 00010000:00010000:2.0:1786400915.534621:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400915.534623:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dbb0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.534629:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dbb0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.534660:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1dba2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb65 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.534673:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5dc00/0x5ccaaf4f3cb1dbb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb65 expref: 11 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.534680:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d6fd022e000) 00010000:00010000:2.0:1786400915.534682:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1786400915.534685:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc4e5dc00, rc 0) 00000100:00100000:2.0:1786400915.534759:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+11:10275:x1873176850098560:12345-192.168.204.8@tcp:101:bash.0 Request processed in 745us (2554us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400915.534767:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 39 00000100:00100000:1.0:1786400915.549159:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400915.550072:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850098816 00000100:00100000:2.0:1786400915.550131:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850098816 00000100:00100000:2.0:1786400915.550242:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 40 00000100:00100000:2.0:1786400915.550254:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+11:10275:x1873176850098816:12345-192.168.204.8@tcp:101:bash.0 00010000:00010000:2.0:1786400915.550277:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400915.550299:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1dbbe lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bb6c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.551044:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dbc5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.551062:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dbc5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.551075:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dbc5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.551772:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1dbcc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.551787:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1dbcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.551795:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1dbcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786400915.553205:0:5790:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1786400915.554001:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dbd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.554017:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dbd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.554040:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dbd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.554080:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dbc5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.554111:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dbc5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.554117:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dbc5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.554122:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5c000 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400915.554126:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dbc5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.554133:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dbc5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.554144:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d6fd022e000) 00010000:00010000:2.0:1786400915.554147:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400915.554151:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dbc5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.554157:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dbc5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786400915.554172:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000248a50b5 reply state 000000007e92bfbc transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1dbcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400915.554182:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1786400915.554230:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1dbbe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb6c expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.554244:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dbd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb6c expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.554251:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fd022ed00) 00010000:00010000:2.0:1786400915.554253:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786400915.554255:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc4e5d600, rc 0) 00000100:00100000:2.0:1786400915.554666:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+14:10275:x1873176850098816:12345-192.168.204.8@tcp:101:bash.0 Request processed in 4413us (5519us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1786400915.554676:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 40 00010000:00010000:3.0:1786400915.560203:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1dbcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400915.560227:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1dbcc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400915.560236:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1dbcc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400915.560259:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5d000 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786400915.560265:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1dbcc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400915.560273:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1dbcc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400915.560290:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d6fd022e300) 00010000:00010000:3.0:1786400915.560294:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400915.560299:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1dbcc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400915.560667:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1dbcc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400915.562023:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400915.562196:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850098944 00000100:00100000:2.0:1786400915.562208:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850098944 00000100:00100000:2.0:1786400915.562256:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 20 00000100:00100000:2.0:1786400915.562266:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6080e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2361:x1873176850098944:12345-192.168.204.8@tcp:8:bash.0 00010000:00080000:2.0:1786400915.562300:0:6590:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 096c63d9-38b8-441b-8c71-343db25fe88a@192.168.204.8@tcp t0 exp 0000000000000000 cur 367 last 0 00000020:00000080:2.0:1786400915.563192:0:6590:0:(genops.c:1406:class_connect()) connect: client 096c63d9-38b8-441b-8c71-343db25fe88a, cookie 0x5ccaaf4f3cb1dbe1 00002000:00100000:2.0:1786400915.563207:0:6590:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 096c63d9-38b8-441b-8c71-343db25fe88a/ffff9d6fc3074000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366c ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1786400915.563221:0:6590:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1786400915.563709:0:6590:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1786400915.563754:0:6590:0:(import.c:65:import_set_state_nolock()) ffff9d6fc3077800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786400915.563831:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6080e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+6:2361:x1873176850098944:12345-192.168.204.8@tcp:8:bash.0 Request processed in 1564us (1814us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400915.563841:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 20 00000100:00100000:0.0:1786400915.575380:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400915.576326:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850099072 00000100:00100000:1.0:1786400915.576339:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850099072 00000100:00100000:1.0:1786400915.576490:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 21 00000100:00100000:1.0:1786400915.576501:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd5b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+6:0:x1873176850099072:12345-192.168.204.8@tcp:101:bash.0 00010000:00010000:1.0:1786400915.576519:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400915.576558:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fff4c76c/0x5ccaaf4f3cb1dbe8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bb73 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786400915.576676:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1786400915.576696:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=367s v=(0 0) 00010000:00010000:1.0:1786400915.576700:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786400915.576710:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fff4c76c/0x5ccaaf4f3cb1dbe8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb73 expref: 7 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.576752:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fff4c76c/0x5ccaaf4f3cb1dbe8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb73 expref: 7 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.576766:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138f400, rc 0) 00000100:00100000:1.0:1786400915.576842:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd5b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+7:0:x1873176850099072:12345-192.168.204.8@tcp:101:bash.0 Request processed in 343us (1473us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400915.576850:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 21 00000100:00080000:2.0:1786400915.578072:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786400915.585434:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400915.585654:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850099200 00000100:00100000:3.0:1786400915.585670:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850099200 00000100:00100000:3.0:1786400915.585759:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 22 00000100:00100000:3.0:1786400915.585772:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6080000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+7:10275:x1873176850099200:12345-192.168.204.8@tcp:101:bash.0 00010000:00010000:3.0:1786400915.585798:0:6593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400915.585828:0:6593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5459cc9/0x5ccaaf4f3cb1dbef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bb7a expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400915.585871:0:6593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fff4c76c/0x5ccaaf4f3cb1dbe8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb73 expref: 8 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400915.585882:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400915.585887:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400915.585908:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5459cc9/0x5ccaaf4f3cb1dbef lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb7a expref: 8 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400915.585962:0:6593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fff4c76c/0x5ccaaf4f3cb1dbe8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb73 expref: 8 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400915.585977:0:6593:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fff4c76c/0x5ccaaf4f3cb1dbe8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb73 expref: 8 pid: 6592 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400915.585994:0:6593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd573b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6593:1873176872151808:192.168.204.8@tcp:104: 00000100:00100000:3.0:1786400915.586437:0:6593:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fff87d840 going to sleep for 11 seconds 00000100:00100000:0.0:1786400915.591795:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400915.592305:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850099328 00000100:00100000:1.0:1786400915.592319:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850099328 00010000:00010000:1.0:1786400915.592364:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fff4c76c/0x5ccaaf4f3cb1dbe8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb73 expref: 9 pid: 6592 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400915.592416:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 35 00000100:00100000:1.0:1786400915.592427:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd5bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096c63d9-38b8-441b-8c71-343db25fe88a+9:2364:x1873176850099328:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400915.592444:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400915.592470:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fff4c76c/0x5ccaaf4f3cb1dbe8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb73 expref: 9 pid: 6592 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.592485:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fff4c76c/0x5ccaaf4f3cb1dbe8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb73 expref: 9 pid: 6592 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.592518:0:5773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786400915.592522:0:5773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786400915.592548:0:5773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5459cc9/0x5ccaaf4f3cb1dbef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb7a expref: 9 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.592559:0:5773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5459cc9/0x5ccaaf4f3cb1dbef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb7a expref: 9 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.592726:0:5773:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a5459cc9/0x5ccaaf4f3cb1dbef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb7a expref: 9 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400915.592742:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc6082680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5773:1873176872151936:192.168.204.8@tcp:105: 00000100:00100000:1.0:1786400915.592832:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffd5b1840 going to sleep for 11 seconds 00010000:00010000:3.0:1786400915.594155:0:6593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fff4c76c/0x5ccaaf4f3cb1dbe8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb73 expref: 9 pid: 6592 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400915.594265:0:6593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd573b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6593:1873176872151808:192.168.204.8@tcp:104: 00010000:00010000:3.0:1786400915.594297:0:6593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5459cc9/0x5ccaaf4f3cb1dbef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb7a expref: 8 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400915.594419:0:6593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7d38a00, rc 0) 00000100:00100000:2.0:1786400915.594812:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6080000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+8:10275:x1873176850099200:12345-192.168.204.8@tcp:101:bash.0 Request processed in 9040us (9392us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400915.594837:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 22 00000100:00100000:1.0:1786400915.596776:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc6082680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5773:1873176872151936:192.168.204.8@tcp:105: 00010000:00010000:1.0:1786400915.596908:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400915.596973:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd5bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096c63d9-38b8-441b-8c71-343db25fe88a+7:2364:x1873176850099328:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 4546us (5187us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400915.596986:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 35 00000100:00100000:0.0:1786400915.605969:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400915.606070:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850099584 00000100:00100000:3.0:1786400915.606080:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850099584 00000100:00100000:3.0:1786400915.606193:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 6 00000100:00100000:3.0:1786400915.606205:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd5bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+13:10275:x1873176850099584:12345-192.168.204.8@tcp:35:bash.0 00000100:00100000:3.0:1786400915.606552:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd5bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+14:10275:x1873176850099584:12345-192.168.204.8@tcp:35:bash.0 Request processed in 349us (592us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1786400915.606575:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 6 00000100:00100000:0.0:1786400915.726556:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400915.726811:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850099840 00000100:00100000:1.0:1786400915.726822:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850099840 00000100:00100000:1.0:1786400915.726999:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 41 00000100:00100000:1.0:1786400915.727008:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd9f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+14:10285:x1873176850099840:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:1.0:1786400915.727032:0:6615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400915.727053:0:6615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1dbf6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bb81 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400915.727859:0:6615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1786400915.727997:0:6615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1dbf6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb81 expref: 16 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.728027:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fd022e500) 00010000:00010000:1.0:1786400915.728030:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786400915.728036:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1dbf6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb81 expref: 16 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.728052:0:6615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138e600, rc 0) 00000100:00100000:1.0:1786400915.728164:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd9f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+15:10285:x1873176850099840:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 1156us (1618us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1786400915.728172:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 41 00000100:00100000:0.0:1786400915.734187:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400915.734598:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850100096 00000100:00100000:3.0:1786400915.734608:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850100096 00000100:00100000:3.0:1786400915.734899:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 7 00000100:00100000:3.0:1786400915.734911:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd9f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+15:10285:x1873176850100096:12345-192.168.204.8@tcp:35:lfs.0 00000100:00100000:3.0:1786400915.735214:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd9f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+16:10285:x1873176850100096:12345-192.168.204.8@tcp:35:lfs.0 Request processed in 304us (1035us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1786400915.735222:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 7 00000100:00100000:0.0:1786400915.812983:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400915.813751:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850100224 00000100:00100000:1.0:1786400915.813762:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850100224 00000100:00100000:1.0:1786400915.814028:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 42 00000100:00100000:1.0:1786400915.814040:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+16:10291:x1873176850100224:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:1.0:1786400915.814073:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400915.814115:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1dc04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bb88 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.814185:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1dc0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.814200:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1dc0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.814213:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1dc0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400915.814278:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1786400915.814296:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1786400915.814324:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1dc0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.816553:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1dc04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb88 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.816600:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1dc0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb88 expref: 17 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.816610:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d6fd022e000) 00010000:00010000:1.0:1786400915.816613:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786400915.816616:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138e400, rc 0) 00000100:00100000:1.0:1786400915.816821:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+17:10291:x1873176850100224:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 2781us (3849us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400915.816832:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 42 00000100:00100000:0.0:1786400915.822953:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400915.823046:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850100480 00000100:00100000:2.0:1786400915.823064:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850100480 00000100:00100000:2.0:1786400915.823212:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 43 00000100:00100000:2.0:1786400915.823226:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd9f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+17:10291:x1873176850100480:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:2.0:1786400915.823257:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400915.823288:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1dc12 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bb8f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.823444:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dc19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.823463:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dc19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.825026:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dc19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400915.825055:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1786400915.826064:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1dc12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb8f expref: 20 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.826138:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dc19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb8f expref: 19 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.826151:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fd022ed00) 00010000:00010000:2.0:1786400915.826155:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786400915.826160:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc4e5c000, rc 0) 00000100:00100000:2.0:1786400915.826288:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd9f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+19:10291:x1873176850100480:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 3063us (3343us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1786400915.826548:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 43 00000100:00100000:0.0:1786400915.831791:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400915.832027:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400915.833667:0:8369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850100864 00000100:00100000:1.0:1786400915.833686:0:8369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850100864 00000100:00100000:1.0:1786400915.833795:0:8369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2 00000100:00100000:1.0:1786400915.833809:0:8369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+19:2362:x1873176850100864:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400915.833832:0:8369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400915.833868:0:8369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dc19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb8f expref: 19 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.833898:0:8369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fd022ed00) 00010000:00010000:1.0:1786400915.833905:0:8369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400915.834009:0:8369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+18:2362:x1873176850100864:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 203us (1981us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400915.834043:0:8369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2 00000100:00100000:2.0:1786400915.837593:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850100736 00000100:00100000:2.0:1786400915.837618:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850100736 00000100:00100000:2.0:1786400915.837923:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 44 00000100:00100000:2.0:1786400915.837937:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd9f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+18:10291:x1873176850100736:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:2.0:1786400915.837972:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400915.838002:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1dc27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bb96 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.838156:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dc2e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.838174:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dc2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.838188:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dc2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400915.838205:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1786400915.838385:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1dc27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb96 expref: 21 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.838407:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dc2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb96 expref: 20 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.838417:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fd022ed00) 00010000:00010000:2.0:1786400915.838421:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1786400915.838442:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc4e5d400, rc 0) 00000100:00100000:2.0:1786400915.838542:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd9f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+20:10291:x1873176850100736:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 608us (6769us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1786400915.838551:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 44 00000100:00100000:0.0:1786400915.852385:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400915.852554:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850100992 00000100:00100000:1.0:1786400915.852567:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850100992 00000100:00100000:1.0:1786400915.852716:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 23 00000100:00100000:1.0:1786400915.852729:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+7:2364:x1873176850100992:12345-192.168.204.8@tcp:1:lfs.0 00010000:00010000:1.0:1786400915.852795:0:6592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000945ba3c4/0x5ccaaf4f3cb1dc3c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.852824:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5459cc9/0x5ccaaf4f3cb1dbef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb7a expref: 7 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.852834:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1786400915.852839:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786400915.852845:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000945ba3c4/0x5ccaaf4f3cb1dc3c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.852892:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a5459cc9/0x5ccaaf4f3cb1dbef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb7a expref: 7 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.852925:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a5459cc9/0x5ccaaf4f3cb1dbef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb7a expref: 7 pid: 6593 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400915.852945:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc6082680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6592:1873176872152064:192.168.204.8@tcp:104: 00000100:00100000:1.0:1786400915.853070:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffd5b1780 going to sleep for 11 seconds 00000100:00100000:0.0:1786400915.862600:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400915.862844:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc6082680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6592:1873176872152064:192.168.204.8@tcp:104: 00010000:00010000:1.0:1786400915.862937:0:6592:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000945ba3c4/0x5ccaaf4f3cb1dc3c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400915.862964:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850101120 00000100:00100000:3.0:1786400915.862979:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850101120 00002000:00100000:3.0:1786400915.863039:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9d6ffd9f1180 x1873176850101120/t0(0) o4->096c63d9-38b8-441b-8c71-343db25fe88a@192.168.204.8@tcp:711/0 lens 504/0 e 0 to 0 dl 1786400926 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786400915.863051:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ffd9f1180 with x1873176850101120 ext(0->12) 00010000:00010000:3.0:1786400915.863060:0:6596:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a5459cc9/0x5ccaaf4f3cb1dbef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb7a expref: 8 pid: 6593 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400915.863078:0:6596:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a5459cc9/0x5ccaaf4f3cb1dbef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb7a expref: 8 pid: 6593 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786400915.864350:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9d6ffd9f1180 00000100:00100000:3.0:1786400915.864401:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 0 00000100:00100000:3.0:1786400915.864421:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd9f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:096c63d9-38b8-441b-8c71-343db25fe88a+8:2365:x1873176850101120:12345-192.168.204.8@tcp:4:lfs.0 00000001:00100000:1.0:1786400915.918790:0:6619:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 096c63d9-38b8-441b-8c71-343db25fe88a 00000100:00100000:0.0:1786400915.971624:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd9f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:096c63d9-38b8-441b-8c71-343db25fe88a+9:2365:x1873176850101120:12345-192.168.204.8@tcp:4:lfs.0 Request processed in 107196us (109017us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1786400915.971651:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 0 00002000:00100000:0.0:1786400915.971669:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9d6ffd9f1180 x1873176850101120/t4294967299(0) o4->096c63d9-38b8-441b-8c71-343db25fe88a@192.168.204.8@tcp:711/0 lens 504/448 e 0 to 0 dl 1786400926 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786400915.971681:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ffd9f1180 with x1873176850101120 ext(0->12) 00010000:00010000:0.0:1786400915.971695:0:6596:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a5459cc9/0x5ccaaf4f3cb1dbef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb7a expref: 9 pid: 6593 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400915.971716:0:6596:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a5459cc9/0x5ccaaf4f3cb1dbef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb7a expref: 9 pid: 6593 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786400915.971726:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9d6ffd9f1180 00000001:00080000:1.0:1786400915.972363:0:6619:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:0.0:1786400915.977781:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400915.978990:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850101248 00000100:00100000:2.0:1786400915.979005:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850101248 00010000:00010000:2.0:1786400915.979064:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a5459cc9/0x5ccaaf4f3cb1dbef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb7a expref: 7 pid: 6593 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400915.979171:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 36 00000100:00100000:2.0:1786400915.979182:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4986300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096c63d9-38b8-441b-8c71-343db25fe88a+7:2363:x1873176850101248:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786400915.979210:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1786400915.979291:0:5774:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1786400915.979296:0:5774:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1786400914 00002000:00010000:2.0:1786400915.979298:0:5774:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1786400914 00002000:00010000:2.0:1786400915.979301:0:5774:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1786400914 00002000:00010000:2.0:1786400915.979303:0:5774:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1786400915.979312:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a5459cc9/0x5ccaaf4f3cb1dbef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb7a expref: 7 pid: 6593 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.979330:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a5459cc9/0x5ccaaf4f3cb1dbef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb7a expref: 7 pid: 6593 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.979368:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5459cc9/0x5ccaaf4f3cb1dbef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb7a expref: 7 pid: 6593 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.979392:0:5774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786400915.979415:0:5774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786400915.979423:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000945ba3c4/0x5ccaaf4f3cb1dc3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.979435:0:5774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000945ba3c4/0x5ccaaf4f3cb1dc3c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.979626:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400915.979709:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4986300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096c63d9-38b8-441b-8c71-343db25fe88a+6:2363:x1873176850101248:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 528us (1944us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400915.979719:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 36 00010000:00010000:3.0:1786400915.980297:0:6592:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000945ba3c4/0x5ccaaf4f3cb1dc3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400915.980328:0:6592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000945ba3c4/0x5ccaaf4f3cb1dc3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400915.980366:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000945ba3c4/0x5ccaaf4f3cb1dc3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400915.980376:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000945ba3c4/0x5ccaaf4f3cb1dc3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400915.980387:0:6592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000945ba3c4/0x5ccaaf4f3cb1dc3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400915.980395:0:6592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138e600 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:3.0:1786400915.980401:0:6592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000945ba3c4/0x5ccaaf4f3cb1dc3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400915.980411:0:6592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000945ba3c4/0x5ccaaf4f3cb1dc3c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400915.980431:0:6592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000945ba3c4/0x5ccaaf4f3cb1dc3c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400915.980439:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000945ba3c4/0x5ccaaf4f3cb1dc3c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400915.980554:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+5:2364:x1873176850100992:12345-192.168.204.8@tcp:1:lfs.0 Request processed in 127825us (128181us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400915.980564:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 23 00000100:00100000:0.0:1786400915.986922:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400915.987047:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850101504 00000100:00100000:1.0:1786400915.987062:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850101504 00000100:00100000:1.0:1786400915.987496:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 8 00000100:00100000:1.0:1786400915.987593:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+20:10291:x1873176850101504:12345-192.168.204.8@tcp:35:lfs.0 00000004:00010000:1.0:1786400915.987690:0:5791:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dc2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb96 expref: 20 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786400915.988140:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1786400915.988210:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1786400915.990943:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1786400915.991081:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1dc43 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.991532:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dbd3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb6c expref: 24 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.991545:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1dc43 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.991617:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dbd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb6c expref: 24 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.991636:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dbd3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb6c expref: 24 pid: 5790 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400915.991678:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc6082680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5791:1873176872152192:192.168.204.8@tcp:104: 00000100:00100000:1.0:1786400915.991814:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffd5b1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1786400915.995454:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc6082680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5791:1873176872152192:192.168.204.8@tcp:104: 00000100:00100000:0.0:1786400915.995531:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:1.0:1786400915.995677:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1dc43 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400915.995776:0:8369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850101632 00000100:00100000:2.0:1786400915.995786:0:8369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850101632 00010000:00010000:2.0:1786400915.995838:0:8369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dbd3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb6c expref: 25 pid: 5790 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400915.995884:0:8369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 37 00000100:00100000:2.0:1786400915.995895:0:8369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4987480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+25:2365:x1873176850101632:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786400915.995917:0:8369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400915.995926:0:8369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dbd3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb6c expref: 25 pid: 5790 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.995939:0:8369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dbd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb6c expref: 25 pid: 5790 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.995967:0:8369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dbd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb6c expref: 25 pid: 5790 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.996011:0:8369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fd022ed00) 00010000:00010000:2.0:1786400915.996017:0:8369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1dc43 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.996028:0:8369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1dc43 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.996036:0:8369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1dc43 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400915.996071:0:8369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786400915.996120:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1dc43 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400915.996127:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1dc43 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400915.996172:0:8369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4987480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+24:2365:x1873176850101632:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 278us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400915.996181:0:8369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 37 00000001:00080000:1.0:1786400915.996535:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1786400915.996815:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1786400915.996952:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc6082680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5791:1873176872152320:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1786400915.997727:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400915.997787:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffd5b1840 going to sleep for 11 seconds 00000100:00100000:0.0:1786400915.997790:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872152320 00000100:00100000:0.0:1786400915.997801:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872152320 00000100:00100000:0.0:1786400915.997934:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1786400915.997945:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5791:x1873176872152320:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1786400915.998058:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5791:x1873176872152320:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 115us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400915.998065:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786400915.998404:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc6082680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5791:1873176872152320:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1786400916.000798:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1786400916.000997:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd573b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5791:1873176872152448:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1786400916.001423:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400916.001726:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872152448 00000100:00100000:1.0:1786400916.001738:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872152448 00000100:00100000:1.0:1786400916.001817:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1786400916.002006:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786400916.002020:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc56af000 going to sleep for 11 seconds 00000100:00100000:1.0:1786400916.002064:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5791:x1873176872152448:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1786400916.003151:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5791:x1873176872152448:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 1089us (1725us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1786400916.003162:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786400916.003367:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd573b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5791:1873176872152448:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1786400916.003475:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1786400916.003538:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1dc43 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.003549:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1dc43 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.003558:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1dc43 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.003581:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138e600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400916.003588:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1dc43 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.003612:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1dc43 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.003633:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fd022ed00) 00010000:00010000:2.0:1786400916.003636:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1786400916.003641:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1dc43 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.003648:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1dc43 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786400916.003916:0:5791:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1786400916.004267:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1786400916.004281:0:5791:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 368405194279ns, next at 369405191904ns, rc = 0 00000001:00080000:2.0:1786400916.004290:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1786400916.004330:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fd022ed00) 00010000:00010000:2.0:1786400916.004334:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1786400916.004344:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dc2e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb96 expref: 28 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400916.004491:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+27:10291:x1873176850101504:12345-192.168.204.8@tcp:35:lfs.0 Request processed in 16983us (17673us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1786400916.004509:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 8 00000020:00080000:2.0:1786400916.004516:0:5791:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1786400916.009037:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400916.009185:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850101760 00000100:00100000:1.0:1786400916.009198:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850101760 00000100:00100000:1.0:1786400916.010105:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 45 00000100:00100000:1.0:1786400916.010120:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+27:10291:x1873176850101760:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:1.0:1786400916.010153:0:6615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400916.010183:0:6615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1dc4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bb9d expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.010338:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1dc4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb9d expref: 28 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.010356:0:6615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1dc4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb9d expref: 28 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.010380:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fe06cbc00) 00010000:00010000:1.0:1786400916.010384:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786400916.010388:0:6615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138f400, rc 0) 00000100:00100000:1.0:1786400916.010473:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+28:10291:x1873176850101760:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 356us (1452us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400916.010481:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 45 00000100:00100000:0.0:1786400916.019020:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400916.019351:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850102016 00000100:00100000:3.0:1786400916.019365:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850102016 00000100:00100000:3.0:1786400916.019436:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 9 00000100:00100000:3.0:1786400916.019448:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6d7fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+28:10291:x1873176850102016:12345-192.168.204.8@tcp:35:lfs.0 00000100:00100000:3.0:1786400916.021385:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6d7fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+29:10291:x1873176850102016:12345-192.168.204.8@tcp:35:lfs.0 Request processed in 1926us (2367us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1786400916.021403:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 9 00000100:00100000:0.0:1786400916.121827:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400916.121947:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850102272 00000100:00100000:1.0:1786400916.121961:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850102272 00000100:00100000:1.0:1786400916.122484:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 46 00000100:00100000:1.0:1786400916.122499:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+29:10301:x1873176850102272:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:1.0:1786400916.122533:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400916.122563:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1dc51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bba4 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400916.122735:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1786400916.122914:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1dc51 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bba4 expref: 31 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.122931:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fd022e500) 00010000:00010000:1.0:1786400916.122935:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786400916.122940:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1dc51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bba4 expref: 31 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.122956:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138f800, rc 0) 00000100:00100000:1.0:1786400916.123029:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+30:10301:x1873176850102272:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 535us (1218us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1786400916.123038:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 46 00000100:00100000:0.0:1786400916.128635:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400916.128771:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850102400 00000100:00100000:2.0:1786400916.128783:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850102400 00000100:00100000:2.0:1786400916.130491:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 47 00000100:00100000:2.0:1786400916.130521:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+30:10301:x1873176850102400:12345-192.168.204.8@tcp:34:lfs.0 00010000:00010000:2.0:1786400916.130673:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dc5f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.130694:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dc5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.130709:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dc5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.130727:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dc66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.130734:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dc66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.130741:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dc66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.130869:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1dc6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.130878:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1dc6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.130885:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1dc6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786400916.130936:0:5789:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1dc6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.130949:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dc5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.130965:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dc5f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.130972:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dc5f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.130979:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5d400 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400916.130984:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dc5f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.130993:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dc5f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.131007:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d6fd022e000) 00010000:00010000:2.0:1786400916.131011:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400916.131017:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dc5f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.131023:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dc5f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.131040:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dc66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.131045:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dc66 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.131051:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dc66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.131056:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5d600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400916.131064:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dc66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.131071:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dc66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.131079:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d6fd022ed00) 00010000:00010000:2.0:1786400916.131081:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400916.131101:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dc66 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.131108:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dc66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.131125:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1dc6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.131132:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1dc6d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.131137:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1dc6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.131142:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5cc00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400916.131144:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1dc6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.131150:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1dc6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.131157:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fe06cbc00) 00010000:00010000:2.0:1786400916.131160:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400916.131169:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1dc6d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.131174:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1dc6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400916.132435:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+30:10301:x1873176850102400:12345-192.168.204.8@tcp:34:lfs.0 Request processed in 1915us (3802us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400916.132451:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 47 00000100:00100000:0.0:1786400916.136863:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400916.136986:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850102656 00000100:00100000:2.0:1786400916.137000:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850102656 00000100:00100000:2.0:1786400916.137169:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 10 00000100:00100000:2.0:1786400916.137182:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d7000dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+30:10301:x1873176850102656:12345-192.168.204.8@tcp:35:lfs.0 00000100:00100000:2.0:1786400916.137540:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d7000dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+31:10301:x1873176850102656:12345-192.168.204.8@tcp:35:lfs.0 Request processed in 359us (689us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1786400916.137549:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 10 00000100:00100000:0.0:1786400916.179241:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400916.179375:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850102912 00000100:00100000:2.0:1786400916.179387:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850102912 00000100:00100000:2.0:1786400916.179519:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 48 00000100:00100000:2.0:1786400916.179533:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d7000dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+31:10304:x1873176850102912:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:2.0:1786400916.179580:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400916.179609:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1dc74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bbab expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.179716:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dc7b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.179734:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dc7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.179773:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dc7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.179792:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dc82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.179800:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dc82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.179807:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dc82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.179977:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dc89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.179987:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dc89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.179994:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dc89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400916.180007:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1786400916.180188:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dc7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.180198:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dc7b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.180205:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dc7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.180211:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5d600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400916.180223:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dc7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.180232:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dc7b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.180247:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d6fd022e000) 00010000:00010000:2.0:1786400916.180250:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400916.180255:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dc7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.180263:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dc7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.180278:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dc82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.180285:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dc82 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.180292:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dc82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.180297:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5d400 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400916.180299:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dc82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.180305:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dc82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.180312:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d6fd022ed00) 00010000:00010000:2.0:1786400916.180314:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400916.180324:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dc82 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.180330:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dc82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.180384:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1dc74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbab expref: 34 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.180399:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dc89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbab expref: 33 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.180407:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fe06cbc00) 00010000:00010000:2.0:1786400916.180410:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786400916.180418:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc4e5c000, rc 0) 00000100:00100000:2.0:1786400916.180492:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d7000dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+33:10304:x1873176850102912:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 963us (1264us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1786400916.180505:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 48 00000100:00100000:0.0:1786400916.184945:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400916.185234:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850103040 00000100:00100000:1.0:1786400916.185248:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850103040 00000100:00100000:1.0:1786400916.185353:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 49 00000100:00100000:1.0:1786400916.185367:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d7000dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+33:10304:x1873176850103040:12345-192.168.204.8@tcp:54:lfs.0 00010000:00010000:1.0:1786400916.185460:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1dc97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.185480:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1dc97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.185493:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1dc97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.185527:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1dc97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.185535:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1dc97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.185562:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1dc97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.185597:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138f800 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400916.185602:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1dc97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.185612:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1dc97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.185628:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fe06cbc00) 00010000:00010000:1.0:1786400916.185693:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786400916.185700:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1dc97 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.185708:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1dc97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400916.185874:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d7000dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+33:10304:x1873176850103040:12345-192.168.204.8@tcp:54:lfs.0 Request processed in 510us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400916.185883:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 49 00000100:00100000:0.0:1786400916.190190:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400916.190348:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850103296 00000100:00100000:1.0:1786400916.190363:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850103296 00000100:00100000:1.0:1786400916.190447:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 11 00000100:00100000:1.0:1786400916.190459:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d7000dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+33:10304:x1873176850103296:12345-192.168.204.8@tcp:35:lfs.0 00000100:00100000:1.0:1786400916.190841:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d7000dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+34:10304:x1873176850103296:12345-192.168.204.8@tcp:35:lfs.0 Request processed in 382us (666us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1786400916.190851:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 11 00010000:00010000:3.0:1786400916.398791:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400916.431646:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400916.432342:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850103552 00000100:00100000:1.0:1786400916.432357:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850103552 00000100:00100000:1.0:1786400916.432442:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 50 00000100:00100000:1.0:1786400916.432465:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d7000dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+34:10335:x1873176850103552:12345-192.168.204.8@tcp:101:cat.0 00010000:00010000:1.0:1786400916.432506:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400916.432535:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1dc9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bbb2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.432698:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1dca5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.432716:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1dca5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.432729:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1dca5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400916.432743:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1786400916.433322:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1dc9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbb2 expref: 37 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.433348:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1dca5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbb2 expref: 36 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.433359:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fe06cbc00) 00010000:00010000:1.0:1786400916.433362:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786400916.433367:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138fa00, rc 0) 00000100:00100000:1.0:1786400916.433455:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d7000dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+36:10335:x1873176850103552:12345-192.168.204.8@tcp:101:cat.0 Request processed in 1003us (1830us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1786400916.433495:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 50 00000100:00100000:0.0:1786400916.438703:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400916.439200:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850103808 00000100:00100000:1.0:1786400916.439217:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850103808 00000100:00100000:1.0:1786400916.439304:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 12 00000100:00100000:1.0:1786400916.439316:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d7000dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+36:10335:x1873176850103808:12345-192.168.204.8@tcp:35:cat.0 00000100:00100000:1.0:1786400916.439885:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d7000dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+37:10335:x1873176850103808:12345-192.168.204.8@tcp:35:cat.0 Request processed in 569us (1198us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1786400916.439895:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 12 00000100:00100000:0.0:1786400916.444652:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400916.445404:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850103936 00000100:00100000:1.0:1786400916.445420:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850103936 00000100:00100000:1.0:1786400916.445522:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 3 00000100:00100000:1.0:1786400916.445536:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4589850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096c63d9-38b8-441b-8c71-343db25fe88a+37:2363:x1873176850103936:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400916.445572:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400916.446029:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1dca5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbb2 expref: 37 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.446055:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fe06cbc00) 00010000:00010000:1.0:1786400916.446061:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400916.446512:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4589850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096c63d9-38b8-441b-8c71-343db25fe88a+36:2363:x1873176850103936:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 976us (1873us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400916.446523:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 3 00000100:00100000:0.0:1786400916.501411:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400916.501554:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850104192 00000100:00100000:2.0:1786400916.501578:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850104192 00000100:00100000:2.0:1786400916.501709:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 51 00000100:00100000:2.0:1786400916.501722:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d7000dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+36:10341:x1873176850104192:12345-192.168.204.8@tcp:101:dd.0 00010000:00010000:2.0:1786400916.501759:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400916.501763:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1786400916.501798:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1dc0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb88 expref: 36 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.501824:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d6fd022e000) 00010000:00010000:2.0:1786400916.501831:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786400916.501877:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1dcb3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bbb9 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.502027:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dcba lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.502044:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dc89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbab expref: 36 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.502055:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dcba lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.502173:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dc89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbab expref: 36 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.502189:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dc89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbab expref: 36 pid: 5790 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400916.502205:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fe9207b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5789:1873176872152576:192.168.204.8@tcp:104: 00000100:00100000:2.0:1786400916.502339:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffde17000 going to sleep for 11 seconds 00000100:00100000:0.0:1786400916.508677:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400916.511589:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fe9207b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5789:1873176872152576:192.168.204.8@tcp:104: 00010000:00010000:2.0:1786400916.511640:0:5789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dcba lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400916.511710:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850104320 00000100:00100000:3.0:1786400916.511721:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850104320 00010000:00010000:3.0:1786400916.511796:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dc89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbab expref: 37 pid: 5790 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400916.511862:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 38 00000100:00100000:3.0:1786400916.511874:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096c63d9-38b8-441b-8c71-343db25fe88a+37:2365:x1873176850104320:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786400916.511894:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400916.511903:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dc89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbab expref: 37 pid: 5790 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400916.511939:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dc89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbab expref: 37 pid: 5790 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400916.511970:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dc89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbab expref: 37 pid: 5790 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400916.511993:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fe06cbc00) 00010000:00010000:3.0:1786400916.512000:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dcba lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400916.512012:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dcba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400916.512021:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dcba lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400916.512080:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400916.512216:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096c63d9-38b8-441b-8c71-343db25fe88a+36:2365:x1873176850104320:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 343us (3553us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400916.512225:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 38 00010000:00010000:0.0:1786400916.512270:0:5789:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dcba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400916.512280:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dcba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400916.512307:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1786400916.512938:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1dcb3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbb9 expref: 37 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400916.512959:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dcba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbb9 expref: 36 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400916.512968:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fe06cbc00) 00010000:00010000:0.0:1786400916.512970:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1786400916.512974:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc4e5d400, rc 0) 00000100:00100000:0.0:1786400916.513066:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d7000dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+36:10341:x1873176850104192:12345-192.168.204.8@tcp:101:dd.0 Request processed in 11345us (11670us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1786400916.513136:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 51 00000100:00100000:0.0:1786400916.518028:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400916.524179:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850104576 00000100:00100000:2.0:1786400916.524202:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850104576 00000100:00100000:2.0:1786400916.526245:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 52 00000100:00100000:2.0:1786400916.526272:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+36:10341:x1873176850104576:12345-192.168.204.8@tcp:36:dd.0 00010000:00010000:2.0:1786400916.527418:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dcc8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.527455:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dcc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.527470:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dcc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786400916.527875:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1786400916.527910:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e8453002 reply state 00000000403e7c4f transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dcc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400916.527920:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786400916.528057:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+39:10341:x1873176850104576:12345-192.168.204.8@tcp:36:dd.0 Request processed in 1796us (10042us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1786400916.528067:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 52 00000020:00080000:2.0:1786400916.528074:0:5790:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1786400916.532493:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dcc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.532511:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dcc8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.532682:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dcc8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.532688:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5c000 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400916.532693:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dcc8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.532702:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dcc8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.532718:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fe06cbc00) 00010000:00010000:1.0:1786400916.532722:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400916.532727:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dcc8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.532733:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dcc8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400916.748976:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400916.749367:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850104704 00000100:00100000:1.0:1786400916.749381:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850104704 00000100:00100000:1.0:1786400916.749546:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 53 00000100:00100000:1.0:1786400916.749570:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+38:10355:x1873176850104704:12345-192.168.204.8@tcp:101:stat.0 00010000:00010000:1.0:1786400916.749607:0:6615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400916.749814:0:6615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1dccf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bbc0 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.749911:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1dcd6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.749929:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1dcd6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.749966:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1dcd6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.749986:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dcdd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.749994:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dcdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.750002:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dcdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.752985:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1dce4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.753012:0:6615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dcba lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbb9 expref: 39 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.753023:0:6615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1dce4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.753075:0:6615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dcba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbb9 expref: 39 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.753139:0:6615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dcba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbb9 expref: 39 pid: 5789 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400916.753156:0:6615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc6082a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6615:1873176872152704:192.168.204.8@tcp:104: 00000100:00100000:1.0:1786400916.753276:0:6615:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc480fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1786400916.760589:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400916.760692:0:6615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc6082a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6615:1873176872152704:192.168.204.8@tcp:104: 00010000:00010000:1.0:1786400916.760743:0:6615:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1dce4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400916.761681:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850104960 00000100:00100000:3.0:1786400916.761695:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850104960 00000100:00100000:3.0:1786400916.762028:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 13 00000100:00100000:3.0:1786400916.762248:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fe9207b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+40:5578:x1873176850104960:12345-192.168.204.8@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1786400916.763551:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fe9207b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+41:5578:x1873176850104960:12345-192.168.204.8@tcp:35:ldlm_bl.0 Request processed in 1300us (2987us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1786400916.763577:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 13 00000100:00100000:0.0:1786400916.769135:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400916.769843:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850105088 00000100:00100000:2.0:1786400916.769862:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850105088 00010000:00010000:2.0:1786400916.769930:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dcba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbb9 expref: 41 pid: 5789 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400916.769984:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 39 00000100:00100000:2.0:1786400916.769995:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096c63d9-38b8-441b-8c71-343db25fe88a+41:2365:x1873176850105088:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786400916.770019:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400916.770028:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dcba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbb9 expref: 41 pid: 5789 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.770045:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dcba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbb9 expref: 41 pid: 5789 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.770138:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dcba lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbb9 expref: 41 pid: 5789 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.770163:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fe06cbc00) 00010000:00010000:2.0:1786400916.770169:0:5774:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1dce4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.770181:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1dce4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.770190:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1dce4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.770227:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786400916.770272:0:6615:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1dce4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.770289:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1dce4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400916.770323:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096c63d9-38b8-441b-8c71-343db25fe88a+40:2365:x1873176850105088:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 327us (1232us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400916.770334:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 39 00000004:00200000:1.0:1786400916.770346:0:6615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1786400916.770353:0:6615:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786400916.770828:0:6615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1dce4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.770844:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1dce4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.770855:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1dcd6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.770863:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1dcd6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.770870:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1dcd6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.770875:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138f800 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400916.770879:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1dcd6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.770887:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1dcd6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.770917:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d6fd022e000) 00010000:00010000:1.0:1786400916.770920:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400916.770924:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1dcd6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.770931:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1dcd6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.770948:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dcdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.770954:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dcdd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.770959:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dcdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.770964:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138e800 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400916.770967:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dcdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.770973:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dcdd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.770980:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d6fe06cb000) 00010000:00010000:1.0:1786400916.770982:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400916.770985:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dcdd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.770991:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dcdd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.771050:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1dccf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbc0 expref: 40 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.771064:0:6615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1dce4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbc0 expref: 39 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400916.771071:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fe06cbc00) 00010000:00010000:1.0:1786400916.771073:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786400916.771076:0:6615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138ee00, rc 0) 00000100:00100000:1.0:1786400916.771208:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+39:10355:x1873176850104704:12345-192.168.204.8@tcp:101:stat.0 Request processed in 21650us (22246us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400916.771219:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 53 00000100:00100000:0.0:1786400916.908759:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400916.908874:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850105344 00000100:00100000:2.0:1786400916.909021:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850105344 00000100:00100000:2.0:1786400916.909139:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 54 00000100:00100000:2.0:1786400916.909152:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+39:10361:x1873176850105344:12345-192.168.204.8@tcp:36:truncate.0 00010000:00010000:2.0:1786400916.910334:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400916.910736:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1dce4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbc0 expref: 39 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.910769:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fe06cbc00) 00010000:00010000:2.0:1786400916.910780:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786400916.911806:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dceb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.911830:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dceb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400916.911842:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dceb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786400916.912079:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1786400916.912147:0:5788:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b31a169a reply state 00000000440eb1bc transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dceb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400916.912158:0:5788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786400916.912624:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+41:10361:x1873176850105344:12345-192.168.204.8@tcp:36:truncate.0 Request processed in 3468us (3876us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1786400916.912634:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 54 00000020:00080000:2.0:1786400916.912643:0:5788:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1786400916.917106:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dceb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400916.917131:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dceb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400916.917140:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dceb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400916.917147:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5d400 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786400916.917154:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dceb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400916.917162:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dceb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400916.917182:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fe06cbc00) 00010000:00010000:3.0:1786400916.917185:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400916.917191:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dceb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400916.917196:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dceb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400917.034700:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400917.034856:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850105472 00000100:00100000:2.0:1786400917.034870:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850105472 00000100:00100000:2.0:1786400917.034971:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 55 00000100:00100000:2.0:1786400917.034986:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5fbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+40:10375:x1873176850105472:12345-192.168.204.8@tcp:101:stat.0 00010000:00010000:2.0:1786400917.035025:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400917.035054:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1dcf2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bbc7 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.035175:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dcf9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.035192:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dcf9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.035228:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dcf9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.035248:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dd00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.035255:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dd00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.035262:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dd00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.035386:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dd07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.035395:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dd07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.035403:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dd07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400917.035448:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1786400917.035453:0:5789:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786400917.035482:0:5789:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dd07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.035496:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dd07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.035505:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dcf9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.035524:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dcf9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.035531:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dcf9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.035539:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5d600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400917.035543:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dcf9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.035565:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dcf9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.035581:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d6fd022e000) 00010000:00010000:2.0:1786400917.035584:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400917.035590:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dcf9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.035596:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1dcf9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.035612:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dd00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.035619:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dd00 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.035625:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dd00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.035630:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5d400 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400917.035638:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dd00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.035646:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dd00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.035653:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d6fd022ed00) 00010000:00010000:2.0:1786400917.035656:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400917.035659:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dd00 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.035665:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dd00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.035698:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1dcf2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbc7 expref: 42 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.035711:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dd07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbc7 expref: 41 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.035719:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fe06cbc00) 00010000:00010000:2.0:1786400917.035721:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786400917.035724:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc4e5c000, rc 0) 00000100:00080000:1.0:1786400917.036173:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786400917.036399:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5fbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+41:10375:x1873176850105472:12345-192.168.204.8@tcp:101:stat.0 Request processed in 1414us (1708us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400917.036408:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 55 00000100:00100000:0.0:1786400917.098401:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400917.098471:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850105728 00000100:00100000:1.0:1786400917.098486:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850105728 00000100:00100000:1.0:1786400917.098610:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 56 00000100:00100000:1.0:1786400917.098622:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5fbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+41:10385:x1873176850105728:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:1.0:1786400917.098651:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400917.098685:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1dd0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bbce expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400917.099068:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1786400917.099345:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1dd0e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbce expref: 43 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.099363:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fd022e500) 00010000:00010000:1.0:1786400917.099375:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786400917.099382:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1dd0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbce expref: 43 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.099401:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138fa00, rc 0) 00000100:00100000:1.0:1786400917.099494:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5fbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+42:10385:x1873176850105728:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 874us (1107us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1786400917.099503:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 56 00000100:00100000:0.0:1786400917.101873:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400917.101929:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850105984 00000100:00100000:1.0:1786400917.101943:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850105984 00000100:00100000:1.0:1786400917.102016:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14 00000100:00100000:1.0:1786400917.102028:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5fbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+42:10385:x1873176850105984:12345-192.168.204.8@tcp:35:lfs.0 00000100:00100000:1.0:1786400917.102661:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5fbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+43:10385:x1873176850105984:12345-192.168.204.8@tcp:35:lfs.0 Request processed in 632us (798us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1786400917.102672:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14 00000100:00100000:0.0:1786400917.189743:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400917.189947:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850106240 00000100:00100000:3.0:1786400917.189961:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850106240 00000100:00100000:3.0:1786400917.190050:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 57 00000100:00100000:3.0:1786400917.190065:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5fbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+43:10391:x1873176850106240:12345-192.168.204.8@tcp:101:bash.0 00010000:00010000:3.0:1786400917.190134:0:6615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400917.190162:0:6615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1dd1c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bbd5 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400917.190724:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1dd23 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400917.190747:0:6615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dd07 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbc7 expref: 44 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400917.190757:0:6615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1dd23 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400917.190808:0:6615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dd07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbc7 expref: 44 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400917.190824:0:6615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dd07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbc7 expref: 44 pid: 5789 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400917.190842:0:6615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd571880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6615:1873176872152832:192.168.204.8@tcp:104: 00000100:00100000:3.0:1786400917.190985:0:6615:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc56af0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786400917.196081:0:6615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd571880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6615:1873176872152832:192.168.204.8@tcp:104: 00010000:00010000:3.0:1786400917.196162:0:6615:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1dd23 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400917.197381:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400917.197581:0:8369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850106368 00000100:00100000:2.0:1786400917.197594:0:8369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850106368 00010000:00010000:2.0:1786400917.197648:0:8369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dd07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbc7 expref: 45 pid: 5789 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400917.197736:0:8369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 40 00000100:00100000:2.0:1786400917.197748:0:8369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5fbed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+45:2365:x1873176850106368:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786400917.197768:0:8369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400917.197777:0:8369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dd07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbc7 expref: 45 pid: 5789 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.197792:0:8369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dd07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbc7 expref: 45 pid: 5789 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.197822:0:8369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dd07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbc7 expref: 45 pid: 5789 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.197843:0:8369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fe06cbc00) 00010000:00010000:2.0:1786400917.197850:0:8369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1dd23 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.197861:0:8369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1dd23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.197870:0:8369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1dd23 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.197918:0:8369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400917.197992:0:8369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5fbed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+44:2365:x1873176850106368:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 245us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400917.198001:0:8369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 40 00010000:00010000:1.0:1786400917.198048:0:6615:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1dd23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.198058:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1dd23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400917.198083:0:6615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1786400917.198335:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1dd1c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbd5 expref: 45 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.198354:0:6615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1dd23 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbd5 expref: 44 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.198377:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fe06cbc00) 00010000:00010000:1.0:1786400917.198380:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1786400917.198383:0:6615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7d38000, rc 0) 00000100:00100000:1.0:1786400917.198418:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5fbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+44:10391:x1873176850106240:12345-192.168.204.8@tcp:101:bash.0 Request processed in 8358us (8692us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1786400917.198427:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 57 00000100:00100000:0.0:1786400917.203878:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400917.203987:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850106624 00000100:00100000:2.0:1786400917.204018:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850106624 00000100:00100000:2.0:1786400917.204132:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 58 00000100:00100000:2.0:1786400917.204145:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5fbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+44:10391:x1873176850106624:12345-192.168.204.8@tcp:36:bash.0 00010000:00010000:2.0:1786400917.207166:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dd31 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.207201:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dd31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.207231:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dd31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786400917.207319:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1786400917.207347:0:5788:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009649e4de reply state 00000000104bcfb4 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dd31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400917.207357:0:5788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786400917.207511:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5fbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+47:10391:x1873176850106624:12345-192.168.204.8@tcp:36:bash.0 Request processed in 3363us (3893us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1786400917.207522:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 58 00000020:00080000:2.0:1786400917.207529:0:5788:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1786400917.210564:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dd31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.210588:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dd31 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.210597:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dd31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.210605:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5c000 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400917.210611:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dd31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.210620:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dd31 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.210641:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fe06cbc00) 00010000:00010000:1.0:1786400917.210645:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400917.210651:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dd31 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.210658:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1dd31 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400917.216478:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400917.217163:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850106752 00000100:00100000:2.0:1786400917.217180:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850106752 00000100:00100000:2.0:1786400917.217858:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 59 00000100:00100000:2.0:1786400917.217878:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5fbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+46:10391:x1873176850106752:12345-192.168.204.8@tcp:101:bash.0 00010000:00010000:2.0:1786400917.217914:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400917.217944:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1dd38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bbdc expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.218058:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dd3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.218124:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1dd23 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbd5 expref: 47 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.218135:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dd3f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.218184:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1dd23 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbd5 expref: 47 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.218200:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1dd23 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbd5 expref: 47 pid: 6615 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400917.218301:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fe9207480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5789:1873176872152960:192.168.204.8@tcp:104: 00000100:00100000:2.0:1786400917.218423:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffde17000 going to sleep for 11 seconds 00000100:00100000:2.0:1786400917.222900:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fe9207480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5789:1873176872152960:192.168.204.8@tcp:104: 00010000:00010000:2.0:1786400917.222944:0:5789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dd3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400917.223904:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400917.224161:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850106880 00000100:00100000:1.0:1786400917.224176:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850106880 00010000:00010000:1.0:1786400917.224363:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1dd23 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbd5 expref: 48 pid: 6615 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400917.224417:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 41 00000100:00100000:1.0:1786400917.224429:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5fbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096c63d9-38b8-441b-8c71-343db25fe88a+48:2365:x1873176850106880:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400917.224588:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400917.224599:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1dd23 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbd5 expref: 48 pid: 6615 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.224616:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1dd23 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbd5 expref: 48 pid: 6615 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.224647:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1dd23 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbd5 expref: 48 pid: 6615 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.224669:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fe06cbc00) 00010000:00010000:1.0:1786400917.224675:0:5773:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dd3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.224686:0:5773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dd3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.224695:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dd3f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.224791:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400917.224899:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5fbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096c63d9-38b8-441b-8c71-343db25fe88a+47:2365:x1873176850106880:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 471us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400917.224907:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 41 00010000:00010000:0.0:1786400917.226812:0:5789:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dd3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400917.226831:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dd3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400917.226905:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1786400917.227051:0:5789:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786400917.227642:0:5789:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dd3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400917.227702:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1dd38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbdc expref: 47 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400917.227729:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dd3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbdc expref: 46 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400917.227764:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fe06cbc00) 00010000:00010000:0.0:1786400917.227767:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786400917.227772:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc4e5d400, rc 0) 00000100:00100000:0.0:1786400917.228171:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5fbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+46:10391:x1873176850106752:12345-192.168.204.8@tcp:101:bash.0 Request processed in 10296us (11706us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400917.228182:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 59 00000100:00100000:0.0:1786400917.234472:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400917.234651:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850107136 00000100:00100000:3.0:1786400917.234665:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850107136 00000100:00100000:3.0:1786400917.234786:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 15 00000100:00100000:3.0:1786400917.234800:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6d7c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+46:10391:x1873176850107136:12345-192.168.204.8@tcp:35:bash.0 00000100:00100000:3.0:1786400917.235392:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6d7c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+47:10391:x1873176850107136:12345-192.168.204.8@tcp:35:bash.0 Request processed in 593us (930us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1786400917.235418:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 15 00000100:00100000:2.0:1786400917.302171:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400917.303071:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850107392 00000100:00100000:1.0:1786400917.303111:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850107392 00000100:00100000:1.0:1786400917.303632:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 60 00000100:00100000:1.0:1786400917.303647:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fe9207480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+47:10401:x1873176850107392:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:1.0:1786400917.303684:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400917.303713:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1dd46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bbe3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400917.304136:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1786400917.304313:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1dd46 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbe3 expref: 49 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.304332:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fd022e500) 00010000:00010000:1.0:1786400917.304335:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786400917.304341:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1dd46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbe3 expref: 49 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.304360:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138fa00, rc 0) 00000100:00100000:1.0:1786400917.304455:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fe9207480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+48:10401:x1873176850107392:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 812us (2298us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1786400917.304463:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 60 00000100:00100000:0.0:1786400917.310875:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400917.311171:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850107520 00000100:00100000:1.0:1786400917.311186:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850107520 00000100:00100000:1.0:1786400917.311264:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 61 00000100:00100000:1.0:1786400917.311275:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5fbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+48:10401:x1873176850107520:12345-192.168.204.8@tcp:34:lfs.0 00010000:00010000:1.0:1786400917.311407:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1dd54 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.311427:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1dd54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.311441:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1dd54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.311459:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dd5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.311467:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dd5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.311475:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dd5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.311930:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1dd62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.311961:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1dd62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.311971:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1dd62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786400917.312031:0:6615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1dd62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.312258:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1dd54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.312280:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1dd54 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.312287:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1dd54 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.312294:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138fa00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400917.312299:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1dd54 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.312307:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1dd54 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.312324:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d6fd022e000) 00010000:00010000:1.0:1786400917.312327:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400917.312333:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1dd54 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.312338:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1dd54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.312354:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dd5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.312360:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dd5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.312367:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dd5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.312504:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138e800 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400917.312515:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dd5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.312522:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dd5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.312607:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d6fe06cb000) 00010000:00010000:1.0:1786400917.312610:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400917.312614:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dd5b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.312620:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dd5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.312641:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1dd62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.312647:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1dd62 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.312653:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1dd62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.312658:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138f800 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400917.312661:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1dd62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.312667:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1dd62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.312675:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fe06cbc00) 00010000:00010000:1.0:1786400917.312677:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400917.312686:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1dd62 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.312705:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1dd62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400917.313575:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5fbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+48:10401:x1873176850107520:12345-192.168.204.8@tcp:34:lfs.0 Request processed in 2292us (2706us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400917.313591:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 61 00000100:00100000:0.0:1786400917.317013:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400917.318124:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850107776 00000100:00100000:1.0:1786400917.318139:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850107776 00000100:00100000:1.0:1786400917.318231:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 16 00000100:00100000:1.0:1786400917.318243:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+48:10401:x1873176850107776:12345-192.168.204.8@tcp:35:lfs.0 00000100:00100000:1.0:1786400917.318991:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+49:10401:x1873176850107776:12345-192.168.204.8@tcp:35:lfs.0 Request processed in 744us (1986us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1786400917.319002:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 16 00000100:00100000:2.0:1786400917.361378:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400917.361877:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850108032 00000100:00100000:1.0:1786400917.361894:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850108032 00000100:00100000:1.0:1786400917.362018:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 62 00000100:00100000:1.0:1786400917.362032:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fe9206300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+49:10404:x1873176850108032:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:1.0:1786400917.362075:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400917.362154:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1dd69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bbea expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.362339:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dd70 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.362357:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dd70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.362394:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dd70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.362414:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1dd77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.362422:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1dd77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.362429:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1dd77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.362704:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1dd7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.362714:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1dd7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.362721:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1dd7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400917.362735:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1786400917.362958:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dd70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.362965:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dd70 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.363027:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dd70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.363032:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138e800 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400917.363044:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dd70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.363050:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dd70 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.363063:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d6fd022e000) 00010000:00010000:1.0:1786400917.363066:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400917.363070:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dd70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.363075:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1dd70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.363115:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1dd77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.363119:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1dd77 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.363122:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1dd77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.363126:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138fa00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400917.363128:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1dd77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.363131:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1dd77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.363135:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d6fe06cb000) 00010000:00010000:1.0:1786400917.363136:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400917.363144:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1dd77 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.363148:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1dd77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.363206:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1dd69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbea expref: 52 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.363216:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1dd7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbea expref: 51 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.363223:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fe06cbc00) 00010000:00010000:1.0:1786400917.363224:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786400917.363226:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138f200, rc 0) 00000100:00100000:1.0:1786400917.363326:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fe9206300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+51:10404:x1873176850108032:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 1297us (1964us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1786400917.363336:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 62 00000100:00100000:0.0:1786400917.367401:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400917.367773:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850108160 00000100:00100000:2.0:1786400917.367790:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850108160 00000100:00100000:2.0:1786400917.367880:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 63 00000100:00100000:2.0:1786400917.367893:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+51:10404:x1873176850108160:12345-192.168.204.8@tcp:54:lfs.0 00010000:00010000:2.0:1786400917.368005:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1dd8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.368055:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1dd8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.368072:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1dd8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.368344:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1dd8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.368353:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1dd8c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.368362:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1dd8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.368369:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5cc00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400917.368374:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1dd8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.368384:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1dd8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.368401:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fe06cbc00) 00010000:00010000:2.0:1786400917.368405:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786400917.368410:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1dd8c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.368417:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1dd8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400917.368775:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400917.368836:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850108288 00000100:00100000:3.0:1786400917.368843:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850108288 00000100:00100000:3.0:1786400917.368904:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4 00000100:00100000:3.0:1786400917.368915:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4908e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096c63d9-38b8-441b-8c71-343db25fe88a+52:2364:x1873176850108288:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786400917.368929:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400917.368948:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1dd7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbea expref: 52 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400917.368965:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fe06cbc00) 00000100:00100000:2.0:1786400917.369060:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+51:10404:x1873176850108160:12345-192.168.204.8@tcp:54:lfs.0 Request processed in 1168us (1673us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400917.369083:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 63 00010000:00010000:3.0:1786400917.369287:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400917.370361:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4908e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096c63d9-38b8-441b-8c71-343db25fe88a+50:2364:x1873176850108288:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 1439us (1579us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400917.370375:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4 00000100:00100000:0.0:1786400917.374733:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400917.374925:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850108544 00000100:00100000:3.0:1786400917.374952:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850108544 00000100:00100000:3.0:1786400917.375266:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 17 00000100:00100000:3.0:1786400917.375279:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+50:10404:x1873176850108544:12345-192.168.204.8@tcp:35:lfs.0 00000100:00100000:3.0:1786400917.376190:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+51:10404:x1873176850108544:12345-192.168.204.8@tcp:35:lfs.0 Request processed in 907us (1470us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1786400917.376205:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 17 00010000:00010000:0.0:1786400917.422563:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400917.573936:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400917.574643:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850108800 00000100:00100000:2.0:1786400917.574661:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850108800 00000100:00100000:2.0:1786400917.574769:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 64 00000100:00100000:2.0:1786400917.574782:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+51:10422:x1873176850108800:12345-192.168.204.8@tcp:101:cat.0 00010000:00010000:2.0:1786400917.574823:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400917.574856:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1dd93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bbf1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.575014:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1dd9a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.575035:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1dd9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.575049:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1dd9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400917.575063:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1786400917.577024:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1dd93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbf1 expref: 54 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.577061:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1dd9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbf1 expref: 53 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.577072:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fe06cbc00) 00010000:00010000:2.0:1786400917.577076:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1786400917.577080:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc4e5d000, rc 0) 00000100:00100000:2.0:1786400917.578388:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+53:10422:x1873176850108800:12345-192.168.204.8@tcp:101:cat.0 Request processed in 3598us (4459us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1786400917.578402:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 64 00000100:00100000:1.0:1786400917.606340:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400917.606670:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850108928 00000100:00100000:3.0:1786400917.606684:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850108928 00000100:00100000:3.0:1786400917.607227:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 65 00000100:00100000:3.0:1786400917.607246:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+53:10423:x1873176850108928:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:3.0:1786400917.607312:0:6615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400917.607342:0:6615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1dda8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bbf8 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400917.607444:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1ddaf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400917.607461:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1ddaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400917.607479:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1ddaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400917.607631:0:6615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1786400917.607637:0:6615:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1786400917.607668:0:6615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1ddaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400917.607702:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1dda8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbf8 expref: 55 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400917.607726:0:6615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1ddaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbf8 expref: 54 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400917.607736:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d6fd022e000) 00010000:00010000:3.0:1786400917.607740:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786400917.607744:0:6615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7d38000, rc 0) 00000100:00100000:3.0:1786400917.607857:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+54:10423:x1873176850108928:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 618us (1538us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400917.607867:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 65 00000100:00100000:0.0:1786400917.619401:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400917.620164:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850109312 00000100:00100000:1.0:1786400917.620177:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850109312 00000100:00100000:1.0:1786400917.620265:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 18 00000100:00100000:1.0:1786400917.620277:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+54:10423:x1873176850109312:12345-192.168.204.8@tcp:35:lfs.0 00000100:00100000:1.0:1786400917.620769:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+55:10423:x1873176850109312:12345-192.168.204.8@tcp:35:lfs.0 Request processed in 492us (1382us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1786400917.620778:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 18 00000100:00100000:0.0:1786400917.625477:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400917.625718:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850109440 00000100:00100000:1.0:1786400917.625734:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850109440 00000100:00100000:1.0:1786400917.625972:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 5 00000100:00100000:1.0:1786400917.625984:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096c63d9-38b8-441b-8c71-343db25fe88a+55:10423:x1873176850109440:12345-192.168.204.8@tcp:103:lfs.0 00010000:00010000:1.0:1786400917.626176:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1786400917.626210:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1dd3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbdc expref: 55 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.626237:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1dd9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbf1 expref: 54 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.626252:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1dc4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb9d expref: 53 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.626279:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fe06cbc00) 00010000:00010000:1.0:1786400917.626294:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400917.626372:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096c63d9-38b8-441b-8c71-343db25fe88a+52:10423:x1873176850109440:12345-192.168.204.8@tcp:103:lfs.0 Request processed in 389us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400917.626381:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 5 00000100:00100000:3.0:1786400917.630880:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400917.632227:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850109568 00000100:00100000:1.0:1786400917.632245:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850109568 00000100:00100000:1.0:1786400917.632793:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 66 00000100:00100000:1.0:1786400917.632808:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+52:10423:x1873176850109568:12345-192.168.204.8@tcp:58:lfs.0 00010000:00010000:1.0:1786400917.633009:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1ddb6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.633045:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1ddb6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.633059:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1ddb6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786400917.633590:0:5788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1786400917.633834:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1786400917.633935:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1786400917.634133:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+52:10423:x1873176850109568:12345-192.168.204.8@tcp:58:lfs.0 Request processed in 1277us (3218us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400917.634146:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 66 00000100:00100000:0.0:1786400917.668282:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400917.669618:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850109696 00000100:00100000:2.0:1786400917.669636:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850109696 00000100:00100000:2.0:1786400917.669728:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 67 00000100:00100000:2.0:1786400917.669743:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+52:10425:x1873176850109696:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:2.0:1786400917.669780:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400917.669815:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1ddbd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bbff expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.670705:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1ddc4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.670731:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1ddc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.670747:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1ddc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.670767:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1ddcb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.670774:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1ddcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.670781:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1ddcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.670922:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1ddd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.670953:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1ddd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.670961:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1ddd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400917.671016:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1786400917.671022:0:5789:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786400917.671061:0:5789:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1ddd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.671076:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1ddd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.671109:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1ddc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.671118:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1ddc4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.671126:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1ddc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.671132:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5d600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400917.671138:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1ddc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.671146:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1ddc4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.671162:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d6fd022e000) 00010000:00010000:2.0:1786400917.671166:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400917.671181:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1ddc4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.671189:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1ddc4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.671207:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1ddcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.671215:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1ddcb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.671220:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1ddcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.671226:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5c000 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400917.671230:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1ddcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.671236:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1ddcb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.671260:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d6fd022ed00) 00010000:00010000:2.0:1786400917.671263:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400917.671267:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1ddcb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.671273:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1ddcb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.671320:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1ddbd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbff expref: 54 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.671351:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1ddd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbff expref: 53 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400917.671359:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fe06cb000) 00010000:00010000:2.0:1786400917.671362:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786400917.671364:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc4e5d000, rc 0) 00000100:00100000:2.0:1786400917.671479:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+53:10425:x1873176850109696:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 1739us (3213us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400917.671490:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 67 00000001:00080000:0.0:1786400917.814597:0:5810:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967333 is committed 00000001:00080000:0.0:1786400917.814620:0:5810:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000004:00080000:0.0:1786400917.820460:0:5810:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:0.0:1786400917.820878:0:5810:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d6fc56af900 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1786400917.820884:0:5810:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d6ec59a3d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d6fc56af540 00000020:00080000:0.0:1786400917.820888:0:5810:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d6ec59a3700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d6ff6fbb000 00000100:00100000:1.0:1786400917.820992:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786400917.821014:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc6082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872153088:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1786400917.821083:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1786400917.821293:0:5822:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1786400917.821419:0:5822:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1786400917.821470:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872153088 00000100:00100000:0.0:1786400917.821479:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872153088 00000100:00100000:1.0:1786400917.821772:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1786400917.821783:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6080380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1873176872153088:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1786400917.821927:0:6590:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1786400917.821962:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a7a5092, atime: 0x6a7a5092, ctime: 0x6a7a5092, blocks: 0xb 00010000:00010000:1.0:1786400917.821970:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a0e177e/0x5ccaaf4f3cb1ddd9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.821987:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=370s v=(0 0) 00010000:00010000:1.0:1786400917.821992:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786400917.821998:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a0e177e/0x5ccaaf4f3cb1ddd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.822013:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a0e177e/0x5ccaaf4f3cb1ddd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.822034:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a0e177e/0x5ccaaf4f3cb1ddd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.822042:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a0e177e/0x5ccaaf4f3cb1ddd9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400917.822064:0:6590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786400917.822409:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786400917.822419:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a0e177e/0x5ccaaf4f3cb1ddd9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400917.822429:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138e800 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:3.0:1786400917.822435:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a0e177e/0x5ccaaf4f3cb1ddd9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400917.822449:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a0e177e/0x5ccaaf4f3cb1ddd9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400917.822470:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a0e177e/0x5ccaaf4f3cb1ddd9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400917.822477:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a0e177e/0x5ccaaf4f3cb1ddd9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400917.822498:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400917.822501:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400917.822503:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400917.823116:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6080380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3309:x1873176872153088:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1331us (2029us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1786400917.823125:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:2.0:1786400917.823292:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d6fc6082d80/2, rc 0, transno 4294967301 00000100:00100000:2.0:1786400917.823299:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc6082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872153088:0@lo:6:osp-syn-0-0.0 00000040:00080000:2.0:1786400918.382562:0:11546:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786400918.382572:0:11546:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786400918.382626:0:11546:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1786400918.382632:0:11546:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786400918.382760:0:11546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fe9205880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11546:1873176872153216:192.168.204.8@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1786400918.382849:0:11546:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffde17780 going to sleep for 11 seconds 00000100:00100000:3.0:1786400918.391389:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400918.391440:0:11546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fe9205880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11546:1873176872153216:192.168.204.8@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786400918.391668:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850109824 00000100:00100000:3.0:1786400918.391675:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850109824 00000100:00100000:3.0:1786400918.391726:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1 00000100:00100000:3.0:1786400918.391736:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:096c63d9-38b8-441b-8c71-343db25fe88a+11:10436:x1873176850109824:12345-192.168.204.8@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1786400918.391813:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:096c63d9-38b8-441b-8c71-343db25fe88a+11:10436:x1873176850109824:12345-192.168.204.8@tcp:900:lhsmtool_posix.0 Request processed in 78us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400918.391822:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1 00000100:00100000:0.0:1786400918.400037:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400918.401144:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850109952 00000100:00100000:1.0:1786400918.401155:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850109952 00000100:00100000:3.0:1786400918.412156:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 68 00000100:00100000:3.0:1786400918.412230:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+11:10436:x1873176850109952:12345-192.168.204.8@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786400918.412266:0:5790:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786400918.412406:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+11:10436:x1873176850109952:12345-192.168.204.8@tcp:53:lhsmtool_posix.0 Request processed in 236us (12379us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400918.412415:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 68 00000100:00100000:3.0:1786400918.419827:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400918.420471:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850110080 00000100:00100000:0.0:1786400918.420481:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850110080 00000100:00100000:0.0:1786400918.420547:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 69 00000100:00100000:0.0:1786400918.420558:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+11:10436:x1873176850110080:12345-192.168.204.8@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1786400918.420648:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1dde0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.420666:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1dde0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.420678:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1dde0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.420743:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1dde7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.420752:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1dde7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.420759:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1dde7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.420785:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1ddee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.420793:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1ddee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.420800:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1ddee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400918.420843:0:6615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1786400918.420855:0:6615:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786400918.420871:0:6615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1ddee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.420909:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1dde0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.420917:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1dde0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.420924:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1dde0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.420930:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aa200 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400918.420934:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1dde0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.420941:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1dde0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.420954:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d6fc5599600) 00010000:00010000:0.0:1786400918.420958:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400918.420963:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1dde0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.420970:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1dde0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.420982:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1dde7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.420989:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1dde7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.421006:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1dde7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.421011:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5ab400 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400918.421015:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1dde7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.421022:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1dde7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.421031:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9d6fc90cd300) 00010000:00010000:0.0:1786400918.421034:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400918.421037:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1dde7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.421043:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1dde7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.421065:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1ddee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.421071:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1ddee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.421077:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1ddee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.421082:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5ab800 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400918.421106:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1ddee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.421124:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1ddee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.421133:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fe06cb000) 00010000:00010000:0.0:1786400918.421135:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400918.421138:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1ddee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.421143:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1ddee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400918.421213:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+11:10436:x1873176850110080:12345-192.168.204.8@tcp:34:lhsmtool_posix.0 Request processed in 656us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400918.421222:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 69 00000100:00100000:1.0:1786400918.429275:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400918.429325:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850110336 00000100:00100000:0.0:1786400918.429336:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850110336 00000100:00100000:0.0:1786400918.429420:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 70 00000100:00100000:0.0:1786400918.429430:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+11:10436:x1873176850110336:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786400918.429451:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400918.429472:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1ddf5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bc06 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.429600:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1ddfc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.429762:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1ddfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.429778:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1ddfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400918.429867:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1786400918.430148:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1ddfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.430154:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1ddfc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.430159:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1ddfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.430163:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aa800 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400918.430167:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1ddfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.430175:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1ddfc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.430187:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fe06cb000) 00010000:00010000:0.0:1786400918.430191:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786400918.430195:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1ddfc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.430202:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1ddfc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.430312:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1ddf5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc06 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.430323:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d6fc5599600) 00010000:00010000:0.0:1786400918.430325:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786400918.430336:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1ddf5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc06 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.430347:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5aba00, rc 0) 00000100:00100000:0.0:1786400918.430410:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+12:10436:x1873176850110336:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 982us (1145us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1786400918.430418:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 70 00000100:00100000:0.0:1786400918.436880:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400918.436987:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850110464 00000100:00100000:2.0:1786400918.436997:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850110464 00000100:00100000:2.0:1786400918.437060:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 71 00000100:00100000:2.0:1786400918.437072:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+12:10436:x1873176850110464:12345-192.168.204.8@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1786400918.437130:0:6615:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1786400918.437447:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+12:10436:x1873176850110464:12345-192.168.204.8@tcp:53:lhsmtool_posix.0 Request processed in 376us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400918.437468:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 71 00000100:00100000:0.0:1786400918.444232:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400918.444320:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850110720 00000100:00100000:3.0:1786400918.444332:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850110720 00000100:00100000:3.0:1786400918.444396:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 72 00000100:00100000:3.0:1786400918.444407:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+12:10436:x1873176850110720:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786400918.444429:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400918.444433:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1786400918.444461:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1ddaf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbf8 expref: 12 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400918.444479:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d6fd022e000) 00010000:00010000:3.0:1786400918.444485:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786400918.444499:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1de0a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bc0d expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786400918.445648:0:5790:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1786400918.447245:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1de11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.447264:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1de11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.447275:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1de11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.447345:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1de0a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc0d expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.447363:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1de11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc0d expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.447373:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:0.0:1786400918.447376:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786400918.447380:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5aba00, rc 0) 00000100:00100000:0.0:1786400918.447445:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+13:10436:x1873176850110720:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 3040us (3222us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1786400918.447462:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 72 00010000:00010000:0.0:1786400918.449581:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786400918.454016:0:11859:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786400918.454027:0:11859:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786400918.454064:0:11859:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1786400918.454071:0:11859:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786400918.457387:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400918.457478:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850110976 00000100:00100000:2.0:1786400918.457488:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850110976 00000100:00100000:2.0:1786400918.457557:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 73 00000100:00100000:2.0:1786400918.457567:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+13:10436:x1873176850110976:12345-192.168.204.8@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786400918.457625:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400918.457653:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1de11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc0d expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.457671:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:2.0:1786400918.457681:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786400918.457703:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1de1f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.457716:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1de1f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.457726:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1de1f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.457790:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1de26 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x92cf00a5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.457798:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1de26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x92cf00a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.457805:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1de26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x92cf00a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.458061:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1de1f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.458075:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1de1f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.458081:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1de1f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.458125:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5d400 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400918.458130:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1de1f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.458137:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1de1f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.458146:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d6fd022e000) 00010000:00010000:2.0:1786400918.458149:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400918.458153:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1de1f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.458159:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1de1f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.458170:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1de26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x92cf00a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.458175:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1de26 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x92cf00a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.458181:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1de26 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x92cf00a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.458185:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5d600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400918.458194:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1de26 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x92cf00a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.458200:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1de26 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x92cf00a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.458209:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x92cf00a5 (ffff9d6fd022ed00) 00010000:00010000:2.0:1786400918.458211:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400918.458214:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1de26 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x92cf00a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.458220:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1de26 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x92cf00a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400918.458673:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+12:10436:x1873176850110976:12345-192.168.204.8@tcp:36:lhsmtool_posix.0 Request processed in 734us (919us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786400918.458682:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 73 00000100:00100000:2.0:1786400918.462193:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400918.462370:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850111104 00000100:00100000:1.0:1786400918.462380:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850111104 00000100:00100000:1.0:1786400918.462484:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 74 00000100:00100000:1.0:1786400918.462495:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fe9207100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+12:10436:x1873176850111104:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786400918.462516:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400918.462552:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1de2d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bc14 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400918.462600:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1de34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400918.462614:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1de34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400918.462626:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1de34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400918.462717:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1de2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc14 expref: 14 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400918.462734:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1de34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc14 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400918.462743:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d6fe06cbd00) 00010000:00010000:1.0:1786400918.462746:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786400918.462750:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138ee00, rc 0) 00000100:00100000:1.0:1786400918.462819:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fe9207100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+13:10436:x1873176850111104:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 325us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400918.462826:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 74 00000100:00100000:0.0:1786400918.468140:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400918.468197:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850111360 00000100:00100000:3.0:1786400918.468214:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850111360 00000100:00100000:3.0:1786400918.468285:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 75 00000100:00100000:3.0:1786400918.468297:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+13:10436:x1873176850111360:12345-192.168.204.8@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1786400918.469125:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1de3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400918.469146:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1de3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400918.469161:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1de3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786400918.470022:0:6615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1786400918.470035:0:6615:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 370870948154ns, next at 371870945374ns, rc = 0 00000004:00010000:3.0:1786400918.470160:0:6615:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003cd1daaa reply state 00000000f11c370f transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1de3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400918.470172:0:6615:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786400918.472155:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+15:10436:x1873176850111360:12345-192.168.204.8@tcp:36:lhsmtool_posix.0 Request processed in 3850us (4295us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1786400918.472169:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 75 00010000:00010000:3.0:1786400918.487271:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1de3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400918.487294:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1de3b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400918.487305:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:3.0:1786400918.487324:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1de3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400918.487332:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7d38000 already unused, calling callback (ffffffffc21904f0) 00000100:00100000:2.0:1786400918.487406:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850111488 00000100:00100000:2.0:1786400918.487418:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850111488 00010000:00010000:3.0:1786400918.487488:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1de3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400918.487500:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1de3b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400918.487512:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 76 00000100:00100000:2.0:1786400918.487536:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+15:10436:x1873176850111488:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786400918.487557:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d6fe06cbd00) 00010000:00010000:2.0:1786400918.487561:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400918.487564:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786400918.487573:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1de3b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400918.487581:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1de3b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.487584:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1de42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bc1b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.487650:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1de42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc1b expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.487665:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1de42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc1b expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.487698:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d6fe06cbd00) 00010000:00010000:2.0:1786400918.487702:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786400918.487705:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc4e5d400, rc 0) 00000100:00100000:2.0:1786400918.487773:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+15:10436:x1873176850111488:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 251us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400918.487781:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 76 00000100:00100000:0.0:1786400918.496561:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400918.496639:0:11770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850111616 00000100:00100000:3.0:1786400918.496649:0:11770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850111616 00000100:00100000:3.0:1786400918.496700:0:11770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 25 00000100:00100000:3.0:1786400918.496709:0:11770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2361:x1873176850111616:12345-192.168.204.8@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1786400918.496741:0:11770:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 096c63d9-38b8-441b-8c71-343db25fe88a@192.168.204.8@tcp t0 exp 0000000000000000 cur 370 last 0 00000020:00000080:3.0:1786400918.496771:0:11770:0:(genops.c:1406:class_connect()) connect: client 096c63d9-38b8-441b-8c71-343db25fe88a, cookie 0x5ccaaf4f3cb1de49 00002000:00100000:3.0:1786400918.496783:0:11770:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 096c63d9-38b8-441b-8c71-343db25fe88a/ffff9d6fc849d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366c ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1786400918.496805:0:11770:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1786400918.497028:0:11770:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1786400918.497073:0:11770:0:(import.c:65:import_set_state_nolock()) ffff9d6ff6fcf800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786400918.497155:0:11770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:096c63d9-38b8-441b-8c71-343db25fe88a+6:2361:x1873176850111616:12345-192.168.204.8@tcp:8:lhsmtool_posix.0 Request processed in 445us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400918.497162:0:11770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 25 00000100:00100000:3.0:1786400918.503258:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400918.503987:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850111744 00000100:00100000:2.0:1786400918.503998:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850111744 00000100:00100000:2.0:1786400918.504074:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 26 00000100:00100000:2.0:1786400918.504106:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+6:0:x1873176850111744:12345-192.168.204.8@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1786400918.505583:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1786400918.566177:0:7501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:0.0:1786400918.566196:0:7501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 096c63d9-38b8-441b-8c71-343db25fe88a 00000100:00100000:2.0:1786400918.571421:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+5:0:x1873176850111744:12345-192.168.204.8@tcp:2:lhsmtool_posix.0 Request processed in 67327us (68162us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1786400918.571435:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 26 00000100:00100000:0.0:1786400918.577546:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400918.577896:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850112000 00000100:00100000:2.0:1786400918.577906:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850112000 00000100:00100000:2.0:1786400918.577970:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 19 00000100:00100000:2.0:1786400918.577981:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+15:10436:x1873176850112000:12345-192.168.204.8@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786400918.578298:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+16:10436:x1873176850112000:12345-192.168.204.8@tcp:35:lhsmtool_posix.0 Request processed in 314us (781us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1786400918.578307:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 19 00000100:00100000:0.0:1786400918.583259:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400918.583403:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850112256 00000100:00100000:2.0:1786400918.583414:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850112256 00000100:00100000:2.0:1786400918.583480:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 77 00000100:00100000:2.0:1786400918.583491:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+16:10436:x1873176850112256:12345-192.168.204.8@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1786400918.583632:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+16:10436:x1873176850112256:12345-192.168.204.8@tcp:57:lhsmtool_posix.0 Request processed in 142us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400918.583640:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 77 00000100:00100000:3.0:1786400918.588716:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400918.588792:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850112384 00000100:00100000:1.0:1786400918.588801:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850112384 00000100:00100000:1.0:1786400918.588856:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 78 00000100:00100000:1.0:1786400918.588866:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+16:10436:x1873176850112384:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786400918.588896:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400918.588918:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1de50 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bc22 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400918.588985:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1de57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400918.589000:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1de57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400918.589011:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1de57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400918.589046:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786400918.589064:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1de57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400918.589313:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1de50 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc22 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400918.589332:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1de57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc22 expref: 17 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400918.589341:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d6fe06cbd00) 00010000:00010000:1.0:1786400918.589344:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786400918.589348:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138e600, rc 0) 00000100:00100000:1.0:1786400918.589440:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+17:10436:x1873176850112384:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 575us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400918.589448:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 78 00000100:00100000:1.0:1786400918.606423:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400918.607734:0:11770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850112512 00000100:00100000:3.0:1786400918.607746:0:11770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850112512 00000100:00100000:3.0:1786400918.609238:0:11770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 27 00000100:00100000:3.0:1786400918.609257:0:11770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6082300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:096c63d9-38b8-441b-8c71-343db25fe88a+5:2364:x1873176850112512:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786400918.609275:0:11770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400918.609299:0:11770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c52dcdc7/0x5ccaaf4f3cb1de5e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bc29 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786400918.609594:0:11770:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a7a5095, blocks: 0x1 00010000:00010000:3.0:1786400918.609616:0:11770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=371s v=(0 0) 00010000:00010000:3.0:1786400918.609621:0:11770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400918.609631:0:11770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c52dcdc7/0x5ccaaf4f3cb1de5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc29 expref: 6 pid: 11770 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400918.609652:0:11770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c52dcdc7/0x5ccaaf4f3cb1de5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc29 expref: 6 pid: 11770 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400918.609667:0:11770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7d38e00, rc 0) 00000100:00100000:3.0:1786400918.609739:0:11770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6082300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:096c63d9-38b8-441b-8c71-343db25fe88a+6:2364:x1873176850112512:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 488us (3324us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400918.609747:0:11770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 27 00000100:00100000:3.0:1786400918.615658:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400918.616260:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850112768 00000100:00100000:2.0:1786400918.616272:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850112768 00000100:00100000:2.0:1786400918.616330:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 79 00000100:00100000:2.0:1786400918.616341:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+17:10436:x1873176850112768:12345-192.168.204.8@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1786400918.616447:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+17:10436:x1873176850112768:12345-192.168.204.8@tcp:57:lhsmtool_posix.0 Request processed in 108us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400918.616468:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 79 00000100:00100000:2.0:1786400918.622587:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400918.622621:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850112896 00000100:00100000:2.0:1786400918.622631:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850112896 00000100:00100000:2.0:1786400918.622696:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 28 00000100:00100000:2.0:1786400918.622708:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fe9205180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+6:10436:x1873176850112896:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786400918.622727:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400918.622750:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9f336e6/0x5ccaaf4f3cb1de65 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bc30 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.622780:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c52dcdc7/0x5ccaaf4f3cb1de5e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc29 expref: 7 pid: 11770 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.622790:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400918.622795:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400918.622800:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9f336e6/0x5ccaaf4f3cb1de65 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc30 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.622845:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c52dcdc7/0x5ccaaf4f3cb1de5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc29 expref: 7 pid: 11770 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.622858:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c52dcdc7/0x5ccaaf4f3cb1de5e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc29 expref: 7 pid: 11770 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400918.622873:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fe9205c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1873176872153344:192.168.204.8@tcp:104: 00000100:00100000:2.0:1786400918.622955:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffde17c00 going to sleep for 11 seconds 00000100:00100000:0.0:1786400918.628322:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fe9205c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1873176872153344:192.168.204.8@tcp:104: 00010000:00010000:0.0:1786400918.628359:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d9f336e6/0x5ccaaf4f3cb1de65 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc30 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.628382:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc4e5c000, rc 0) 00000100:00100000:0.0:1786400918.629848:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fe9205180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+7:10436:x1873176850112896:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 7136us (7263us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400918.629860:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 28 00000100:00100000:0.0:1786400918.629985:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400918.630258:0:8369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850113024 00000100:00100000:2.0:1786400918.630268:0:8369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850113024 00010000:00010000:2.0:1786400918.630381:0:8369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c52dcdc7/0x5ccaaf4f3cb1de5e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc29 expref: 7 pid: 11770 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400918.630416:0:8369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 42 00000100:00100000:2.0:1786400918.630425:0:8369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4588850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+7:2365:x1873176850113024:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786400918.630440:0:8369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400918.630461:0:8369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c52dcdc7/0x5ccaaf4f3cb1de5e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc29 expref: 7 pid: 11770 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.630473:0:8369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c52dcdc7/0x5ccaaf4f3cb1de5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc29 expref: 7 pid: 11770 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.630499:0:8369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c52dcdc7/0x5ccaaf4f3cb1de5e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc29 expref: 7 pid: 11770 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.630547:0:8369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400918.630551:0:8369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400918.630560:0:8369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9f336e6/0x5ccaaf4f3cb1de65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc30 expref: 6 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.630569:0:8369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9f336e6/0x5ccaaf4f3cb1de65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc30 expref: 6 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.630610:0:8369:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d9f336e6/0x5ccaaf4f3cb1de65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc30 expref: 6 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400918.630624:0:8369:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fe9204a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8369:1873176872153472:192.168.204.8@tcp:105: 00000100:00100000:2.0:1786400918.630701:0:8369:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffde17780 going to sleep for 11 seconds 00000100:00100000:1.0:1786400918.632874:0:8369:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fe9204a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8369:1873176872153472:192.168.204.8@tcp:105: 00010000:00010000:1.0:1786400918.632902:0:8369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400918.632951:0:8369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4588850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+6:2365:x1873176850113024:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 2527us (2966us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400918.632960:0:8369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 42 00000100:00100000:0.0:1786400918.635423:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400918.636073:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850113152 00000100:00100000:2.0:1786400918.636118:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850113152 00002000:00100000:2.0:1786400918.636184:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9d6fee1bd880 x1873176850113152/t0(0) o4->096c63d9-38b8-441b-8c71-343db25fe88a@192.168.204.8@tcp:714/0 lens 504/0 e 0 to 0 dl 1786400929 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786400918.636198:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6fee1bd880 with x1873176850113152 ext(0->8) 00002000:00010000:2.0:1786400918.636204:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d6fee1bd880 00000100:00100000:2.0:1786400918.636236:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 0 00000100:00100000:2.0:1786400918.636256:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:096c63d9-38b8-441b-8c71-343db25fe88a+6:2364:x1873176850113152:12345-192.168.204.8@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1786400918.637065:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:096c63d9-38b8-441b-8c71-343db25fe88a+8:2364:x1873176850113152:12345-192.168.204.8@tcp:4:lhsmtool_posix.0 Request processed in 807us (1648us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1786400918.637102:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 0 00002000:00100000:2.0:1786400918.637111:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9d6fee1bd880 x1873176850113152/t4294967302(0) o4->096c63d9-38b8-441b-8c71-343db25fe88a@192.168.204.8@tcp:714/0 lens 504/448 e 0 to 0 dl 1786400929 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786400918.637119:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6fee1bd880 with x1873176850113152 ext(0->8) 00002000:00010000:2.0:1786400918.637123:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d6fee1bd880 00000100:00100000:0.0:1786400918.640996:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400918.641161:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850113280 00000100:00100000:2.0:1786400918.641172:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850113280 00000100:00100000:2.0:1786400918.641230:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 80 00000100:00100000:2.0:1786400918.641242:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+17:10436:x1873176850113280:12345-192.168.204.8@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1786400918.678221:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+17:10436:x1873176850113280:12345-192.168.204.8@tcp:44:lhsmtool_posix.0 Request processed in 36969us (37220us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400918.678246:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 80 00000001:00080000:1.0:1786400918.678582:0:5810:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000020:00080000:1.0:1786400918.678600:0:5810:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:1.0:1786400918.678616:0:5810:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1786400918.678637:0:5810:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1786400918.679470:0:5822:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1786400918.679483:0:5822:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1786400918.679492:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786400918.679510:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872153600:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1786400918.679575:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400918.679780:0:11770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872153600 00000100:00100000:3.0:1786400918.679789:0:11770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872153600 00000100:00100000:3.0:1786400918.679846:0:11770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1786400918.679855:0:11770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fe9205500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872153600:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1786400918.680027:0:11770:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1786400918.680030:0:11770:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1786400917 00002000:00010000:3.0:1786400918.680032:0:11770:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1786400918.680035:0:11770:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1786400917 -> 1786400917 00002000:00010000:3.0:1786400918.680037:0:11770:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00080000:1.0:1786400918.680064:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786400918.680123:0:11770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fe9205500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1873176872153600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 269us (547us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1786400918.680131:0:11770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:0.0:1786400918.680239:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d6ffd573800/2, rc 0, transno 4294967303 00000100:00100000:0.0:1786400918.680246:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872153600:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786400918.683311:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400918.683505:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850113408 00000100:00100000:2.0:1786400918.683516:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850113408 00000100:00100000:2.0:1786400918.683587:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 30 00000100:00100000:2.0:1786400918.683597:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+8:2365:x1873176850113408:12345-192.168.204.8@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1786400918.721248:0:7501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:1.0:1786400918.721720:0:7501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:2.0:1786400918.722142:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+6:2365:x1873176850113408:12345-192.168.204.8@tcp:16:lhsmtool_posix.0 Request processed in 38541us (38832us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400918.722159:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 30 00000100:00100000:0.0:1786400918.728475:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400918.729236:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850113664 00000100:00100000:2.0:1786400918.729425:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850113664 00000100:00100000:2.0:1786400918.729558:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 81 00000100:00100000:2.0:1786400918.729569:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+13:10436:x1873176850113664:12345-192.168.204.8@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786400918.729621:0:6615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400918.729651:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1de57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc22 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.729670:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d6fe06cbd00) 00010000:00010000:2.0:1786400918.729676:0:6615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786400918.729711:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1de6c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.729725:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1de6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.729735:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1de6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786400918.731349:0:6615:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008fd0a33e reply state 000000004bb9a1f0 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1de6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400918.731367:0:6615:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786400918.731610:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+14:10436:x1873176850113664:12345-192.168.204.8@tcp:36:lhsmtool_posix.0 Request processed in 2039us (3142us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1786400918.731619:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 81 00010000:00010000:1.0:1786400918.736349:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1de6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400918.736367:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1de6c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400918.736375:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1de6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400918.736381:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5d600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400918.736386:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1de6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400918.736393:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1de6c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400918.736409:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d6fe06cbd00) 00010000:00010000:1.0:1786400918.736412:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400918.736431:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1de6c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400918.736438:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1de6c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400918.742812:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400918.742949:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850113792 00000100:00100000:2.0:1786400918.742960:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850113792 00000100:00100000:2.0:1786400918.743018:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 31 00000100:00100000:2.0:1786400918.743028:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+6:2364:x1873176850113792:12345-192.168.204.8@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1786400918.743337:0:6592:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1786400918.743340:0:6592:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1786400917 -> 1786400915 00002000:00010000:2.0:1786400918.743342:0:6592:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1786400914 00002000:00010000:2.0:1786400918.743345:0:6592:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1786400917 -> 1786400915 00002000:00010000:2.0:1786400918.743346:0:6592:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1786400918.743409:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+7:2364:x1873176850113792:12345-192.168.204.8@tcp:2:lhsmtool_posix.0 Request processed in 381us (606us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1786400918.743416:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 31 00000100:00100000:0.0:1786400918.748648:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400918.748744:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850114048 00000100:00100000:1.0:1786400918.748756:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850114048 00000100:00100000:1.0:1786400918.748870:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 82 00000100:00100000:1.0:1786400918.748881:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+13:10436:x1873176850114048:12345-192.168.204.8@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1786400918.748952:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1de73 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400918.748969:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1de34 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc14 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400918.748978:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1de73 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400918.749014:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1de34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc14 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400918.749027:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1de34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc14 expref: 13 pid: 5788 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400918.749042:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc6081880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5788:1873176872153728:192.168.204.8@tcp:104: 00000100:00100000:1.0:1786400918.749170:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc9c7ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1786400918.756253:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400918.756358:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850114176 00000100:00100000:2.0:1786400918.756368:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850114176 00010000:00010000:2.0:1786400918.756412:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1de34 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc14 expref: 14 pid: 5788 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400918.756490:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 43 00000100:00100000:2.0:1786400918.756500:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6082680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096c63d9-38b8-441b-8c71-343db25fe88a+14:2365:x1873176850114176:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786400918.756514:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400918.756531:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1de34 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc14 expref: 14 pid: 5788 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.756545:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1de34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc14 expref: 14 pid: 5788 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.756568:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d6fe06cbd00) 00010000:00010000:2.0:1786400918.756572:0:5774:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1de73 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.756581:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1de73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.756602:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1de73 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.756620:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400918.756688:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6082680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096c63d9-38b8-441b-8c71-343db25fe88a+14:2365:x1873176850114176:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 188us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400918.756695:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 43 00010000:00010000:0.0:1786400918.757831:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1de34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc14 expref: 13 pid: 5788 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400918.757865:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc6081880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5788:1873176872153728:192.168.204.8@tcp:104: 00010000:00010000:0.0:1786400918.757892:0:5788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1de73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.758235:0:5788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1de73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.758252:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1de73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.758283:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1de73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.758291:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1de73 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.758298:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1de73 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.758304:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138e400 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400918.758309:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1de73 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.758316:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1de73 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.758331:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d6fe06cbd00) 00010000:00010000:0.0:1786400918.758334:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1786400918.758339:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1de73 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.758354:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1de73 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400918.758425:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+12:10436:x1873176850114048:12345-192.168.204.8@tcp:55:lhsmtool_posix.0 Request processed in 9545us (9786us total) trans 0 rc -22/-22 00000100:00100000:0.0:1786400918.758435:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 82 00000100:00100000:1.0:1786400918.762359:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400918.762878:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850114304 00000100:00100000:0.0:1786400918.762889:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850114304 00000100:00100000:0.0:1786400918.762953:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 32 00000100:00100000:0.0:1786400918.762964:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+7:2364:x1873176850114304:12345-192.168.204.8@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1786400918.763006:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000074c3fdff/0x5ccaaf4f3cb1de7a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.763027:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9f336e6/0x5ccaaf4f3cb1de65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc30 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.763036:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786400918.763041:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786400918.763045:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074c3fdff/0x5ccaaf4f3cb1de7a lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.763410:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d9f336e6/0x5ccaaf4f3cb1de65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc30 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.763430:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d9f336e6/0x5ccaaf4f3cb1de65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc30 expref: 7 pid: 6590 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400918.763467:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee1bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1873176872153856:192.168.204.8@tcp:104: 00000100:00100000:0.0:1786400918.763558:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fee1f3300 going to sleep for 11 seconds 00000100:00100000:2.0:1786400918.768020:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee1bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6590:1873176872153856:192.168.204.8@tcp:104: 00010000:00010000:2.0:1786400918.768051:0:6590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000074c3fdff/0x5ccaaf4f3cb1de7a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400918.769020:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400918.769123:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850114432 00000100:00100000:3.0:1786400918.769131:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850114432 00010000:00010000:3.0:1786400918.769171:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d9f336e6/0x5ccaaf4f3cb1de65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc30 expref: 8 pid: 6590 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400918.769207:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 44 00000100:00100000:3.0:1786400918.769217:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096c63d9-38b8-441b-8c71-343db25fe88a+8:2364:x1873176850114432:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786400918.769230:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400918.769257:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d9f336e6/0x5ccaaf4f3cb1de65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc30 expref: 8 pid: 6590 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400918.769270:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d9f336e6/0x5ccaaf4f3cb1de65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc30 expref: 8 pid: 6590 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400918.769294:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9f336e6/0x5ccaaf4f3cb1de65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc30 expref: 8 pid: 6590 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400918.769322:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786400918.769326:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786400918.769332:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000074c3fdff/0x5ccaaf4f3cb1de7a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400918.769342:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074c3fdff/0x5ccaaf4f3cb1de7a lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.769596:0:6590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000074c3fdff/0x5ccaaf4f3cb1de7a lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.769606:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074c3fdff/0x5ccaaf4f3cb1de7a lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.769636:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000074c3fdff/0x5ccaaf4f3cb1de7a lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.769645:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074c3fdff/0x5ccaaf4f3cb1de7a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.769652:0:6590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074c3fdff/0x5ccaaf4f3cb1de7a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.769670:0:6590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aa400 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:2.0:1786400918.769675:0:6590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074c3fdff/0x5ccaaf4f3cb1de7a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.769684:0:6590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074c3fdff/0x5ccaaf4f3cb1de7a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400918.769693:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786400918.769696:0:6590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074c3fdff/0x5ccaaf4f3cb1de7a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.769702:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074c3fdff/0x5ccaaf4f3cb1de7a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400918.769780:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6081880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+7:2364:x1873176850114304:12345-192.168.204.8@tcp:1:lhsmtool_posix.0 Request processed in 6818us (7428us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400918.769788:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 32 00000100:00100000:3.0:1786400918.769843:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096c63d9-38b8-441b-8c71-343db25fe88a+6:2364:x1873176850114432:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 627us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400918.769850:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 44 00000100:00100000:0.0:1786400918.773312:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400918.773596:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850114688 00000100:00100000:1.0:1786400918.773607:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850114688 00000100:00100000:1.0:1786400918.773906:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 83 00000100:00100000:1.0:1786400918.773919:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+12:10436:x1873176850114688:12345-192.168.204.8@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1786400918.774020:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1de81 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400918.774037:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1de81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400918.774048:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1de81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400918.774584:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1de88 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400918.774596:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1de42 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc1b expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400918.774604:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1de88 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400918.774640:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1de42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc1b expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400918.774654:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1de42 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc1b expref: 13 pid: 5790 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400918.774681:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f9b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5789:1873176872153984:192.168.204.8@tcp:104: 00000100:00100000:1.0:1786400918.774787:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc9c7e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400918.781221:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400918.781239:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f9b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5789:1873176872153984:192.168.204.8@tcp:104: 00010000:00010000:1.0:1786400918.781268:0:5789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1de88 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400918.782992:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850114816 00000100:00100000:2.0:1786400918.783004:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850114816 00010000:00010000:2.0:1786400918.783047:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1de42 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc1b expref: 14 pid: 5790 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400918.783115:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 45 00000100:00100000:2.0:1786400918.783125:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096c63d9-38b8-441b-8c71-343db25fe88a+14:2365:x1873176850114816:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786400918.783138:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400918.783144:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1de42 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc1b expref: 14 pid: 5790 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.783173:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1de42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc1b expref: 14 pid: 5790 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.783195:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1de42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc1b expref: 14 pid: 5790 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.783212:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d6fe06cbd00) 00010000:00010000:2.0:1786400918.783217:0:5773:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1de88 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.783762:0:5773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1de88 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.783771:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1de88 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.783807:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786400918.783846:0:5789:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1de88 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400918.783856:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1de88 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786400918.784063:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1786400918.784260:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1786400918.784315:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1786400918.784422:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f9b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5789:1873176872154112:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1786400918.784473:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400918.784503:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc35fc240 going to sleep for 11 seconds 00000100:00100000:2.0:1786400918.786430:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096c63d9-38b8-441b-8c71-343db25fe88a+16:2365:x1873176850114816:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 747us (2660us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400918.786449:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 45 00000100:00100000:0.0:1786400918.786663:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872154112 00000100:00100000:0.0:1786400918.786676:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872154112 00000100:00100000:0.0:1786400918.786736:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786400918.786751:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5fbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5789:x1873176872154112:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1786400918.786876:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5fbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5789:x1873176872154112:12345-0@lo:1000:mdt00_001.0 Request processed in 127us (2401us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400918.786883:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1786400918.786971:0:5789:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1786400918.786979:0:5789:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d6ffd573800, transno 4294967303 00000100:00100000:2.0:1786400918.787000:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f9b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5789:1873176872154112:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1786400918.788347:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1786400918.788425:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fe9207800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5789:1873176872154240:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1786400918.788496:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400918.788545:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc9c7e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400918.788564:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872154240 00000100:00100000:0.0:1786400918.788571:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872154240 00000100:00100000:0.0:1786400918.788616:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786400918.788624:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fe9204e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5789:x1873176872154240:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1786400918.788830:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fe9204e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5789:x1873176872154240:12345-0@lo:1000:mdt00_001.0 Request processed in 206us (333us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1786400918.788839:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1786400918.788951:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fe9207800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5789:1873176872154240:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1786400918.788986:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1de88 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.788998:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1de88 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.789006:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1de88 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.789013:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138ee00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400918.789018:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1de88 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.789026:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1de88 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.789042:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d6fe06cbd00) 00010000:00010000:2.0:1786400918.789045:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786400918.789050:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1de88 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.789056:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1de88 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.789116:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1ddb6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.789124:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1ddb6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.789129:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1ddb6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.789141:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138fa00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400918.789144:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1ddb6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.789150:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1ddb6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.789159:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fe06cb000) 00010000:00010000:2.0:1786400918.789161:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786400918.789163:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1ddb6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.789169:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1ddb6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.789192:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1de8f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.789205:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1ddd2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbff expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.789213:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1de8f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.789237:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1ddd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbff expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.789250:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1ddd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbff expref: 16 pid: 5789 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400918.789277:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fe9204000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5789:1873176872154368:192.168.204.8@tcp:104: 00000100:00100000:2.0:1786400918.790532:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc9c7e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400918.796950:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fe9204000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5789:1873176872154368:192.168.204.8@tcp:104: 00010000:00010000:2.0:1786400918.796983:0:5789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1de8f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400918.797858:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400918.798057:0:8369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850114944 00000100:00100000:1.0:1786400918.798068:0:8369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850114944 00010000:00010000:1.0:1786400918.798272:0:8369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1ddd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbff expref: 17 pid: 5789 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400918.798539:0:8369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 46 00000100:00100000:1.0:1786400918.798562:0:8369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+17:2365:x1873176850114944:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400918.798590:0:8369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400918.798600:0:8369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1ddd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbff expref: 17 pid: 5789 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400918.798752:0:8369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1ddd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbff expref: 17 pid: 5789 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400918.798798:0:8369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1ddd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bbff expref: 17 pid: 5789 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400918.798816:0:8369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fe06cb000) 00010000:00010000:1.0:1786400918.798821:0:8369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1de8f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400918.798831:0:8369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1de8f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400918.798838:0:8369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1de8f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400918.798872:0:8369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400918.798964:0:8369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+16:2365:x1873176850114944:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 414us (1111us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400918.798972:0:8369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 46 00010000:00010000:2.0:1786400918.799241:0:5789:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1de8f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.799251:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1de8f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.799279:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1de8f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.799286:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1de8f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.799292:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1de8f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.799297:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5cc00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400918.799301:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1de8f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.799309:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1de8f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.799319:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fe06cb000) 00010000:00010000:2.0:1786400918.799329:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400918.799334:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1de8f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.799340:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1de8f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.799353:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1de81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.799359:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1de81 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.799365:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1de81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.799370:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138e400 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400918.799373:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1de81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.799379:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1de81 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.799387:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fe06cb000) 00010000:00010000:2.0:1786400918.799388:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786400918.799391:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1de81 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400918.799396:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1de81 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400918.799669:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+15:10436:x1873176850114688:12345-192.168.204.8@tcp:57:lhsmtool_posix.0 Request processed in 25752us (26366us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1786400918.799687:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 83 00000020:00080000:2.0:1786400918.799692:0:5789:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1786400918.800844:0:11546:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786400918.800852:0:11546:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786400918.800906:0:11546:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1786400918.800914:0:11546:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786400918.812012:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400918.812187:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850115200 00000100:00100000:3.0:1786400918.812197:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850115200 00000100:00100000:3.0:1786400918.812270:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 20 00000100:00100000:3.0:1786400918.812280:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd61e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+15:10436:x1873176850115200:12345-192.168.204.8@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1786400918.815062:0:5791:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1786400918.815224:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1786400918.818728:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1de96 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400918.818757:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1de96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400918.818769:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1de96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400918.818799:0:5791:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1de96 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400918.818806:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1de96 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400918.818813:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1de96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400918.818921:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786400918.819073:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd61e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+17:10436:x1873176850115200:12345-192.168.204.8@tcp:35:lhsmtool_posix.0 Request processed in 6789us (7066us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1786400918.819112:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 20 00000020:00080000:3.0:1786400918.819119:0:5791:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1786400918.819306:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786400918.819322:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1de96 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.819329:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7d38000 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:0.0:1786400918.819333:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1de96 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.819341:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1de96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.819355:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9d6fc5599b00) 00010000:00010000:0.0:1786400918.819358:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786400918.819362:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1de96 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.819367:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1de96 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400918.819388:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400918.819390:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400918.819392:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400919.278409:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872154496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786400919.278483:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400919.278760:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872154496 00000100:00100000:1.0:1786400919.278770:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872154496 00000100:00100000:1.0:1786400919.279315:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1786400919.279326:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fe9204000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1873176872154496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786400919.279368:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400919.279431:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fe9204000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1873176872154496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400919.279438:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1786400919.279928:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872154496:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1786400919.280271:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1786400919.470301:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400919.601433:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400919.601486:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400919.601554:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850115328 00000100:00100000:3.0:1786400919.601564:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850115328 00000100:00100000:1.0:1786400919.601774:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850115456 00000100:00100000:1.0:1786400919.601779:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850115456 00000100:00100000:1.0:1786400919.601836:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 129 00000100:00100000:1.0:1786400919.601845:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fe9206680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+17:2363:x1873176850115456:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:1.0:1786400919.601926:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fe9206680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+17:2363:x1873176850115456:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 83us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400919.601935:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 129 00000100:00080000:1.0:1786400919.602075:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400919.602555:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 284 00000100:00100000:3.0:1786400919.602568:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2363:x1873176850115328:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:3.0:1786400919.602605:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2363:x1873176850115328:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 42us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400919.602611:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 284 00000100:00100000:2.0:1786400919.605598:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400919.606202:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400919.606765:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400919.606793:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850115840 00000100:00100000:2.0:1786400919.606801:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850115840 00000100:00100000:2.0:1786400919.606858:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 130 00000100:00100000:2.0:1786400919.606868:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fe9206d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2362:x1873176850115840:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:2.0:1786400919.606936:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fe9206d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2362:x1873176850115840:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 69us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400919.606944:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 130 00000100:00080000:2.0:1786400919.606985:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400919.607972:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850115712 00000100:00100000:3.0:1786400919.607980:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850115712 00000100:00100000:3.0:1786400919.608021:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850115584 00000100:00100000:3.0:1786400919.608024:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850115584 00000100:00100000:3.0:1786400919.608052:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 49 00000100:00100000:3.0:1786400919.608060:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fe9205f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+6:2362:x1873176850115712:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:3.0:1786400919.608133:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fe9205f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+6:2362:x1873176850115712:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 73us (2544us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400919.608141:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 49 00000100:00100000:3.0:1786400919.608168:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 50 00000100:00100000:3.0:1786400919.608176:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fe9206a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+5:2362:x1873176850115584:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:3.0:1786400919.608201:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fe9206a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+5:2362:x1873176850115584:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 27us (2002us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400919.608207:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 50 00000100:00080000:3.0:1786400919.608226:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786400919.791055:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872154752:0@lo:400:kworker.0 00000100:00100000:2.0:1786400919.791287:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400919.791458:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872154752 00000100:00100000:1.0:1786400919.791466:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872154752 00000100:00100000:1.0:1786400919.791524:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1786400919.791671:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5fbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872154624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786400919.791711:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400919.791742:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+19:3308:x1873176872154752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400919.791768:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872154624 00000100:00100000:0.0:1786400919.791774:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872154624 00000100:00100000:1.0:1786400919.791804:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+19:3308:x1873176872154752:12345-0@lo:400:kworker.0 Request processed in 66us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400919.791813:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1786400919.791821:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd61df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1873176872154624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786400919.791849:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786400919.791888:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd61df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1873176872154624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400919.791915:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1786400919.791974:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5fbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872154624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786400919.792019:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872154752:0@lo:400:kworker.0 00000100:00100000:0.0:1786400919.792404:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873176872155264:0@lo:400:kworker.0 00000100:00100000:0.0:1786400919.792440:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400919.792455:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872155008:0@lo:400:kworker.0 00000100:00100000:0.0:1786400919.792468:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786400919.792477:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873176872154880:0@lo:400:kworker.0 00000100:00100000:0.0:1786400919.792512:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400919.792543:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872155264 00000100:00100000:3.0:1786400919.792548:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400919.792549:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872155264 00000100:00100000:3.0:1786400919.792575:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786400919.792583:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872155136:0@lo:400:kworker.0 00000100:00100000:0.0:1786400919.792596:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872154880 00000100:00100000:0.0:1786400919.792600:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872154880 00000100:00100000:0.0:1786400919.792616:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872155008 00000100:00100000:0.0:1786400919.792619:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872155008 00000100:00100000:3.0:1786400919.792627:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400919.792637:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1786400919.792645:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd61ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873176872155264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400919.792663:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872155136 00000100:00100000:3.0:1786400919.792679:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872155136 00000100:00100000:0.0:1786400919.792687:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd61ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873176872155264:12345-0@lo:400:kworker.0 Request processed in 42us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400919.792694:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1786400919.792710:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1786400919.792718:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1786400919.792721:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd61ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873176872154880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400919.792730:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1873176872155136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400919.792755:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd61ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873176872154880:12345-0@lo:400:kworker.0 Request processed in 37us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400919.792763:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1786400919.792780:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1873176872155136:12345-0@lo:400:kworker.0 Request processed in 52us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400919.792781:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1786400919.792790:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1786400919.792805:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872155008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400919.792838:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872155136:0@lo:400:kworker.0 00000100:00100000:0.0:1786400919.792846:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872155008:12345-0@lo:400:kworker.0 Request processed in 45us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400919.792857:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872155008:0@lo:400:kworker.0 00000100:00100000:0.0:1786400919.792858:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:2.0:1786400919.792873:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400919.792910:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873176872154880:0@lo:400:kworker.0 00000100:00100000:0.0:1786400919.792922:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873176872155264:0@lo:400:kworker.0 00000100:00100000:1.0:1786400919.793815:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000040:00080000:1.0:1786400920.149675:0:11912:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786400920.149686:0:11912:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786400920.149725:0:11912:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1786400920.149732:0:11912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786400920.247225:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400920.249242:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850116096 00000100:00100000:0.0:1786400920.249258:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850116096 00000100:00100000:0.0:1786400920.249320:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 84 00000100:00100000:0.0:1786400920.249329:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fe9204380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+17:10455:x1873176850116096:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:0.0:1786400920.249349:0:6615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400920.249368:0:6615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1de9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bc37 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.249637:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1dea4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.249653:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1dea4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.249665:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1dea4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400920.249677:0:6615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1786400920.249844:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1de9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc37 expref: 20 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.249862:0:6615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1dea4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc37 expref: 19 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.249877:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d6fd022e000) 00010000:00010000:0.0:1786400920.249880:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1786400920.249885:0:6615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5aa800, rc 0) 00000100:00100000:0.0:1786400920.249962:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fe9204380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+19:10455:x1873176850116096:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 633us (2745us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1786400920.249970:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 84 00000100:00100000:3.0:1786400920.254670:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400920.255031:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850116224 00000100:00100000:3.0:1786400920.255042:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850116224 00000100:00100000:3.0:1786400920.255120:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 85 00000100:00100000:3.0:1786400920.255131:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+19:10455:x1873176850116224:12345-192.168.204.8@tcp:34:lfs.0 00010000:00010000:3.0:1786400920.255207:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1deb2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.255227:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1deb2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.255241:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1deb2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.255257:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1deb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.255264:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1deb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.255271:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1deb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.255567:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1dec0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.255576:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1dec0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.255584:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1dec0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786400920.255625:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1dec0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.255644:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1deb2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.255650:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1deb2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.255657:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1deb2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.255663:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7d38a00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786400920.255668:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1deb2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.255675:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1deb2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.255688:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d6fd022e000) 00010000:00010000:3.0:1786400920.255691:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400920.255695:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1deb2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.255700:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1deb2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.255710:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1deb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.255716:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1deb9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.255721:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1deb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.255731:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7d38400 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786400920.255733:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1deb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.255739:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1deb9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.255747:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d6fc5599100) 00010000:00010000:3.0:1786400920.255749:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400920.255751:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1deb9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.255757:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1deb9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.255770:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1dec0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.255776:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1dec0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.255782:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1dec0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.255787:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7d38000 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786400920.255790:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1dec0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.255796:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1dec0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.255815:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fc5599c00) 00010000:00010000:3.0:1786400920.255817:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400920.255820:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1dec0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.255825:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1dec0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400920.255905:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+19:10455:x1873176850116224:12345-192.168.204.8@tcp:34:lfs.0 Request processed in 775us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400920.255913:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 85 00000100:00100000:3.0:1786400920.305171:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400920.305260:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850116480 00000100:00100000:0.0:1786400920.305270:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850116480 00000100:00100000:0.0:1786400920.305709:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 86 00000100:00100000:0.0:1786400920.305721:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+19:10458:x1873176850116480:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:0.0:1786400920.305740:0:6615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400920.305762:0:6615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1dec7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bc3e expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.305834:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1dece lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.305848:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1dece lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.305859:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1dece lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.305874:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1ded5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.305881:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1ded5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.305908:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1ded5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.306283:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1dedc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.306292:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1dedc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.306299:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1dedc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400920.306309:0:6615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1786400920.306413:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1dece lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.306421:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1dece lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.306427:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1dece lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.306432:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5ab800 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400920.306436:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1dece lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.306443:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1dece lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.306454:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d6fd022e000) 00010000:00010000:0.0:1786400920.306457:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400920.306467:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1dece lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.306473:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1dece lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.306868:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1ded5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.307220:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1ded5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.307230:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1ded5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.307236:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5ab400 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400920.307239:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1ded5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.307246:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1ded5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.307256:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d6fc90cdd00) 00010000:00010000:0.0:1786400920.307258:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400920.307261:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1ded5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.307267:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1ded5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.307322:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1dec7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc3e expref: 22 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.308506:0:6615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1dedc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc3e expref: 21 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.308514:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fc90cd400) 00010000:00010000:0.0:1786400920.308517:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786400920.308520:0:6615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5aa200, rc 0) 00000100:00100000:0.0:1786400920.308602:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+21:10458:x1873176850116480:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 2882us (3440us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1786400920.308612:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 86 00000100:00100000:3.0:1786400920.313052:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400920.313254:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850116608 00000100:00100000:2.0:1786400920.313266:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850116608 00000100:00100000:2.0:1786400920.313330:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 87 00000100:00100000:2.0:1786400920.313340:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+21:10458:x1873176850116608:12345-192.168.204.8@tcp:54:lfs.0 00010000:00010000:2.0:1786400920.313420:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1deea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.313434:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1deea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.313444:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1deea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.313472:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1deea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.313479:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1deea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.313514:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1deea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.313521:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5d600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400920.313525:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1deea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.313533:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1deea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.313544:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fc90cd400) 00010000:00010000:2.0:1786400920.313548:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786400920.313552:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1deea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.313559:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1deea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400920.313897:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+21:10458:x1873176850116608:12345-192.168.204.8@tcp:54:lfs.0 Request processed in 558us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400920.313906:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 87 00000100:00100000:3.0:1786400920.318899:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400920.319720:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850116864 00000100:00100000:2.0:1786400920.319731:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850116864 00000100:00100000:2.0:1786400920.319839:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 21 00000100:00100000:2.0:1786400920.319850:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6d7e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+21:10458:x1873176850116864:12345-192.168.204.8@tcp:35:lfs.0 00000100:00100000:2.0:1786400920.320109:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6d7e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+22:10458:x1873176850116864:12345-192.168.204.8@tcp:35:lfs.0 Request processed in 261us (1220us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1786400920.320118:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 21 00000100:00100000:3.0:1786400920.355635:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400920.355797:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850117120 00000100:00100000:2.0:1786400920.355811:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850117120 00000100:00100000:2.0:1786400920.355885:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 88 00000100:00100000:2.0:1786400920.355896:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+22:9977:x1873176850117120:12345-192.168.204.8@tcp:101:bash.0 00010000:00010000:2.0:1786400920.355929:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400920.355952:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1def1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bc45 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.356065:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1def8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.356081:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1dedc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc3e expref: 23 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.356134:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1def8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.356189:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1dedc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc3e expref: 23 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.356215:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1dedc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc3e expref: 23 pid: 6615 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400920.356231:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fe9204a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5790:1873176872155392:192.168.204.8@tcp:104: 00000100:00100000:2.0:1786400920.357253:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc35fc240 going to sleep for 11 seconds 00000100:00100000:0.0:1786400920.364901:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400920.365384:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fe9204a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5790:1873176872155392:192.168.204.8@tcp:104: 00010000:00010000:2.0:1786400920.365414:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1def8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400920.365649:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850117248 00000100:00100000:1.0:1786400920.365659:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850117248 00010000:00010000:1.0:1786400920.365709:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1dedc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc3e expref: 24 pid: 6615 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400920.366361:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 47 00000100:00100000:1.0:1786400920.366374:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd61c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096c63d9-38b8-441b-8c71-343db25fe88a+24:2365:x1873176850117248:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400920.366392:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400920.366399:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1dedc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc3e expref: 24 pid: 6615 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400920.366431:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1dedc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc3e expref: 24 pid: 6615 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400920.366452:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1dedc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc3e expref: 24 pid: 6615 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400920.366469:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fc90cd400) 00010000:00010000:1.0:1786400920.366475:0:5774:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1def8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400920.366494:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1def8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400920.366502:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1def8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400920.366537:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400920.366651:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd61c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096c63d9-38b8-441b-8c71-343db25fe88a+23:2365:x1873176850117248:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 279us (1760us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400920.366659:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 47 00010000:00010000:0.0:1786400920.366719:0:5790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1def8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.366727:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1def8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400920.366744:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1786400920.366896:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1def1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc45 expref: 24 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.366912:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1def8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc45 expref: 23 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.366920:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fc90cd400) 00010000:00010000:0.0:1786400920.366923:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1786400920.366926:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc4e5c000, rc 0) 00000100:00100000:0.0:1786400920.366951:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+23:9977:x1873176850117120:12345-192.168.204.8@tcp:101:bash.0 Request processed in 11057us (11331us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1786400920.366964:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 88 00000100:00100000:2.0:1786400920.372718:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400920.372831:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850117504 00000100:00100000:3.0:1786400920.372843:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850117504 00000100:00100000:3.0:1786400920.372948:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 89 00000100:00100000:3.0:1786400920.372961:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fe9204a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+23:9977:x1873176850117504:12345-192.168.204.8@tcp:36:bash.0 00010000:00010000:3.0:1786400920.373374:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1df06 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.373391:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1df06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.373403:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1df06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786400920.373455:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1786400920.373507:0:5788:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000368c45c8 reply state 000000001b8d07e9 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1df06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400920.373517:0:5788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1786400920.373565:0:5788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1786400920.373671:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fe9204a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+27:9977:x1873176850117504:12345-192.168.204.8@tcp:36:bash.0 Request processed in 711us (962us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1786400920.373678:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 89 00000020:00080000:3.0:1786400920.373684:0:5788:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1786400920.378672:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1df06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400920.378690:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1df06 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400920.378697:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1df06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400920.378719:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7d38e00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400920.378724:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1df06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400920.378732:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1df06 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400920.378750:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fc90cd400) 00010000:00010000:1.0:1786400920.378754:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400920.378759:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1df06 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400920.378765:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1df06 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400920.382851:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400920.383399:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850117632 00000100:00100000:0.0:1786400920.383409:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850117632 00000100:00100000:0.0:1786400920.383467:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 90 00000100:00100000:0.0:1786400920.383478:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fe9205c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+26:9977:x1873176850117632:12345-192.168.204.8@tcp:101:bash.0 00010000:00010000:0.0:1786400920.383514:0:6615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400920.383536:0:6615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1df0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bc4c expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.383608:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1df0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc4c expref: 27 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.383623:0:6615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1df0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc4c expref: 27 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.383643:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fc90cd400) 00010000:00010000:0.0:1786400920.383647:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786400920.383650:0:6615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5ab400, rc 0) 00000100:00100000:0.0:1786400920.383708:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fe9205c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+27:9977:x1873176850117632:12345-192.168.204.8@tcp:101:bash.0 Request processed in 232us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400920.383716:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 90 00000100:00100000:3.0:1786400920.386806:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400920.386915:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850117760 00000100:00100000:2.0:1786400920.386925:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850117760 00000100:00100000:2.0:1786400920.387001:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 33 00000100:00100000:2.0:1786400920.387012:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d7000dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+6:9977:x1873176850117760:12345-192.168.204.8@tcp:101:bash.0 00010000:00010000:2.0:1786400920.387031:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400920.387054:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f3657a3/0x5ccaaf4f3cb1df14 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bc53 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786400920.387081:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a7a5093, atime: 0x6a7a5092, ctime: 0x6a7a5093, blocks: 0xb 00010000:00010000:2.0:1786400920.387144:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=372s v=(0 0) 00010000:00010000:2.0:1786400920.387149:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400920.387157:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f3657a3/0x5ccaaf4f3cb1df14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc53 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.387189:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007f3657a3/0x5ccaaf4f3cb1df14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc53 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.387202:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc4e5d000, rc 0) 00000100:00100000:2.0:1786400920.387324:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d7000dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+7:9977:x1873176850117760:12345-192.168.204.8@tcp:101:bash.0 Request processed in 314us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400920.387332:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 33 00000100:00080000:3.0:1786400920.387398:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786400920.392040:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400920.392339:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850117888 00000100:00100000:3.0:1786400920.392350:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850117888 00002000:00010000:3.0:1786400920.392407:0:6596:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1786400920.392413:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ffd61c700 with x1873176850117888 ext(0->18446744073709551615) 00002000:00010000:3.0:1786400920.392426:0:6596:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d6ffd61c700. 00000100:00100000:3.0:1786400920.392500:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1 00000100:00100000:3.0:1786400920.392513:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd61c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:096c63d9-38b8-441b-8c71-343db25fe88a+7:2362:x1873176850117888:12345-192.168.204.8@tcp:10:bash.0 00002000:00010000:3.0:1786400920.392808:0:6596:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1786400920.392812:0:6596:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1786400915 -> 1786400919 00002000:00010000:3.0:1786400920.392814:0:6596:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1786400914 -> 1786400914 00002000:00010000:3.0:1786400920.392817:0:6596:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1786400915 -> 1786400919 00002000:00010000:3.0:1786400920.392819:0:6596:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1786400920.392929:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd61c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:096c63d9-38b8-441b-8c71-343db25fe88a+8:2362:x1873176850117888:12345-192.168.204.8@tcp:10:bash.0 Request processed in 418us (898us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1786400920.392938:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1 00002000:00010000:3.0:1786400920.392941:0:6596:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1786400920.392944:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ffd61c700 with x1873176850117888 ext(0->18446744073709551615) 00002000:00010000:3.0:1786400920.392964:0:6596:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d6ffd61c700. 00000100:00100000:0.0:1786400920.474329:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400920.474461:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850118016 00000100:00100000:2.0:1786400920.474474:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850118016 00000100:00100000:2.0:1786400920.474543:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 91 00000100:00100000:2.0:1786400920.474552:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd61fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+27:10472:x1873176850118016:12345-192.168.204.8@tcp:34:lfs.0 00010000:00010000:2.0:1786400920.474647:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1df1b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.474665:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1df1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.474677:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1df1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.474694:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1df22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.474702:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1df22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.474709:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1df22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.475586:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1df29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.475597:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1df29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.475606:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1df29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786400920.475645:0:5789:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1df29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.475655:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1df1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.475662:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1df1b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.475668:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1df1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.475674:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5cc00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400920.475678:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1df1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.475686:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1df1b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.475697:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d6fd022e000) 00010000:00010000:2.0:1786400920.475700:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400920.475705:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1df1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.475718:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1df1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.475731:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1df22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.475736:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1df22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.475742:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1df22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.475747:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5d600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400920.475750:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1df22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.475756:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1df22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.475764:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d6fd022e900) 00010000:00010000:2.0:1786400920.475767:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400920.475770:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1df22 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.475776:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1df22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.475790:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1df29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.475797:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1df29 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.475809:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1df29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.475815:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5d400 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400920.475818:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1df29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.475824:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1df29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.475833:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fc90cd400) 00010000:00010000:2.0:1786400920.475836:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400920.475839:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1df29 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.475845:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1df29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400920.475917:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd61fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+27:10472:x1873176850118016:12345-192.168.204.8@tcp:34:lfs.0 Request processed in 1364us (1595us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400920.475926:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 91 00010000:00010000:0.0:1786400920.494338:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400920.519565:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400920.519733:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850118272 00000100:00100000:0.0:1786400920.519746:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850118272 00000100:00100000:0.0:1786400920.519827:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 92 00000100:00100000:0.0:1786400920.519858:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fe9205880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+27:10475:x1873176850118272:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:0.0:1786400920.519887:0:6615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400920.519917:0:6615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1df30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bc5a expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.520017:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1df37 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.520036:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1df37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.520051:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1df37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.520070:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1df3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.520077:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1df3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.520083:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1df3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.520598:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1df45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.520611:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1df45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.520618:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1df45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400920.520644:0:6615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1786400920.520772:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1df37 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.520781:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1df37 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.520787:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1df37 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.520793:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5ab200 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400920.520798:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1df37 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.520806:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1df37 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.520820:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d6fd022e000) 00010000:00010000:0.0:1786400920.520823:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400920.520828:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1df37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.520834:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1df37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.520849:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1df3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.520855:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1df3e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.520871:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1df3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.520876:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aa600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400920.520879:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1df3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.520886:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1df3e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.520894:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d6fc90cdd00) 00010000:00010000:0.0:1786400920.520896:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400920.520899:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1df3e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.520905:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1df3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.520961:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1df30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc5a expref: 30 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.520979:0:6615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1df45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc5a expref: 29 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.520986:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fc90cd400) 00010000:00010000:0.0:1786400920.520988:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1786400920.520991:0:6615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5aaa00, rc 0) 00000100:00100000:0.0:1786400920.521423:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fe9205880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+29:10475:x1873176850118272:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 1565us (1872us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1786400920.521443:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 92 00000100:00100000:0.0:1786400920.525430:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400920.525552:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850118400 00000100:00100000:3.0:1786400920.525565:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850118400 00000100:00100000:3.0:1786400920.525658:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 93 00000100:00100000:3.0:1786400920.525671:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd61f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+29:10475:x1873176850118400:12345-192.168.204.8@tcp:54:lfs.0 00010000:00010000:3.0:1786400920.525771:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1df53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.525794:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1def8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc45 expref: 29 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.525805:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1df53 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.525849:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1def8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc45 expref: 29 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.525865:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1def8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc45 expref: 29 pid: 5790 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400920.525882:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5788:1873176872155520:192.168.204.8@tcp:104: 00000100:00100000:3.0:1786400920.526010:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffd5b1240 going to sleep for 11 seconds 00000100:00100000:3.0:1786400920.530318:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5788:1873176872155520:192.168.204.8@tcp:104: 00010000:00010000:3.0:1786400920.530366:0:5788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1df53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400920.530633:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400920.530742:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850118656 00000100:00100000:3.0:1786400920.530750:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850118656 00000100:00100000:3.0:1786400920.531005:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 22 00000100:00100000:3.0:1786400920.531018:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd61e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+30:5578:x1873176850118656:12345-192.168.204.8@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1786400920.531822:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd61e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+31:5578:x1873176850118656:12345-192.168.204.8@tcp:35:ldlm_bl.0 Request processed in 803us (1186us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1786400920.531834:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 22 00000100:00100000:2.0:1786400920.534672:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400920.534807:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850118784 00000100:00100000:3.0:1786400920.534820:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850118784 00010000:00010000:3.0:1786400920.534882:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1def8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc45 expref: 31 pid: 5790 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400920.534939:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 48 00000100:00100000:3.0:1786400920.534950:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fe9207b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096c63d9-38b8-441b-8c71-343db25fe88a+31:2364:x1873176850118784:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786400920.534970:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400920.534978:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1def8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc45 expref: 31 pid: 5790 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.534992:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1def8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc45 expref: 31 pid: 5790 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.535026:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1def8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc45 expref: 31 pid: 5790 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.535048:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fc90cd400) 00010000:00010000:3.0:1786400920.535054:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1df53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.535066:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1df53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.535272:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1df53 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.535315:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400920.535392:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fe9207b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096c63d9-38b8-441b-8c71-343db25fe88a+30:2364:x1873176850118784:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 442us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400920.535401:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 48 00010000:00010000:2.0:1786400920.535667:0:5788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1df53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.535676:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1df53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.535716:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1df53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.535732:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1df53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.535739:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1df53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.535745:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7d38000 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400920.535750:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1df53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.535758:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1df53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.535769:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fc90cd400) 00010000:00010000:2.0:1786400920.535772:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786400920.535776:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1df53 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.535781:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1df53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400920.535830:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd61f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+29:10475:x1873176850118400:12345-192.168.204.8@tcp:54:lfs.0 Request processed in 10161us (10415us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400920.535839:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 93 00000100:00100000:0.0:1786400920.541014:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400920.541299:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850119040 00000100:00100000:2.0:1786400920.541314:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850119040 00000100:00100000:2.0:1786400920.541394:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 23 00000100:00100000:2.0:1786400920.541407:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd61d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+29:10475:x1873176850119040:12345-192.168.204.8@tcp:35:lfs.0 00000100:00100000:2.0:1786400920.541768:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd61d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+30:10475:x1873176850119040:12345-192.168.204.8@tcp:35:lfs.0 Request processed in 362us (770us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1786400920.541797:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 23 00000100:00100000:3.0:1786400920.627602:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400920.627667:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400920.628410:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850119168 00000100:00100000:2.0:1786400920.628424:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850119168 00002000:00100000:2.0:1786400920.628508:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->7) req@ffff9d7000dd4000 x1873176850119168/t0(0) o4->096c63d9-38b8-441b-8c71-343db25fe88a@192.168.204.8@tcp:716/0 lens 496/0 e 0 to 0 dl 1786400931 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786400920.628520:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d7000dd4000 with x1873176850119168 ext(0->7) 00002000:00010000:2.0:1786400920.628527:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d7000dd4000 00000100:00100000:2.0:1786400920.628693:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2 00000100:00100000:2.0:1786400920.628705:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d7000dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:096c63d9-38b8-441b-8c71-343db25fe88a+8:2362:x1873176850119168:12345-192.168.204.8@tcp:4:bash.0 00000100:00100000:0.0:1786400920.628788:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850119296 00000100:00100000:0.0:1786400920.628793:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850119296 00000100:00100000:0.0:1786400920.628833:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 34 00000100:00100000:0.0:1786400920.628840:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d7000dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+9:2362:x1873176850119296:12345-192.168.204.8@tcp:16:kworker.0 00000100:00100000:3.0:1786400920.630936:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d7000dd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:096c63d9-38b8-441b-8c71-343db25fe88a+11:2362:x1873176850119168:12345-192.168.204.8@tcp:4:bash.0 Request processed in 2218us (3253us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1786400920.630954:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2 00002000:00100000:3.0:1786400920.631569:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->7) req@ffff9d7000dd4000 x1873176850119168/t4294967307(0) o4->096c63d9-38b8-441b-8c71-343db25fe88a@192.168.204.8@tcp:716/0 lens 496/448 e 0 to 0 dl 1786400931 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786400920.631582:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d7000dd4000 with x1873176850119168 ext(0->7) 00002000:00010000:3.0:1786400920.631591:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d7000dd4000 00000100:00100000:0.0:1786400920.632350:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400920.632474:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850119552 00000100:00100000:3.0:1786400920.632496:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850119552 00000100:00100000:3.0:1786400920.632596:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 94 00000100:00100000:3.0:1786400920.632607:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd61f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+30:10486:x1873176850119552:12345-192.168.204.8@tcp:101:cat.0 00010000:00010000:3.0:1786400920.632633:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400920.632657:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1df5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bc61 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.632743:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1df61 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.632879:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1df61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.632895:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1df61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.632912:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1df68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.632919:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1df68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.632925:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1df68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.633792:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1df6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.633805:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1df6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.633814:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1df6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400920.633827:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1786400920.633941:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1df61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.633950:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1df61 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.633957:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1df61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.633986:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7d38400 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786400920.633991:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1df61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.634000:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1df61 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.634016:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d6fd022e000) 00010000:00010000:3.0:1786400920.634019:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400920.634025:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1df61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.634031:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1df61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.634046:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1df68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.634052:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1df68 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.634058:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1df68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.634062:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7d39600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786400920.634065:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1df68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.634070:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1df68 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.634126:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d6fc5599a00) 00010000:00010000:3.0:1786400920.634129:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400920.634132:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1df68 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.634139:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1df68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.634204:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1df5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc61 expref: 33 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.634219:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1df6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc61 expref: 32 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.634226:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fc90cd400) 00010000:00010000:3.0:1786400920.634229:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786400920.634232:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7d38000, rc 0) 00000100:00100000:3.0:1786400920.634327:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd61f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+32:10486:x1873176850119552:12345-192.168.204.8@tcp:101:cat.0 Request processed in 1720us (1980us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1786400920.634336:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 94 00000100:00100000:2.0:1786400920.642898:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400920.643076:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850119808 00000100:00100000:0.0:1786400920.643132:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850119808 00000100:00100000:0.0:1786400920.643211:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 24 00000100:00100000:0.0:1786400920.643226:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+32:10486:x1873176850119808:12345-192.168.204.8@tcp:35:cat.0 00000100:00100000:0.0:1786400920.645269:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+33:10486:x1873176850119808:12345-192.168.204.8@tcp:35:cat.0 Request processed in 2022us (2361us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1786400920.645286:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 24 00000100:00100000:0.0:1786400920.677816:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400920.678128:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850120064 00000100:00100000:2.0:1786400920.678139:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850120064 00000100:00100000:2.0:1786400920.678193:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 95 00000100:00100000:2.0:1786400920.678208:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd61d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+33:10487:x1873176850120064:12345-192.168.204.8@tcp:36:rm.0 00010000:00010000:2.0:1786400920.678262:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1786400920.678290:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1df6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc61 expref: 33 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.678310:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1df45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc5a expref: 32 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.678321:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1df0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc4c expref: 31 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.678785:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fc90cd400) 00010000:00010000:2.0:1786400920.678805:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786400920.678827:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1df7d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.678839:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1df7d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.678848:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1df7d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.678861:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1df84 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.678868:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1df84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.678874:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1df84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.679186:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1df8b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.679195:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1df8b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.679214:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1df8b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786400920.680028:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1786400920.680038:0:5789:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 373080950818ns, next at 374080948708ns, rc = 0 00010000:00010000:2.0:1786400920.680119:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1df92 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.680139:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1df92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.680146:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1df92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.680153:0:5789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1df92 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.680159:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1df92 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.680164:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1df92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.680182:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786400920.680201:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1df8b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.680207:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1df8b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.680212:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1df8b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.680217:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5d400 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400920.680221:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1df8b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.680228:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1df8b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.680245:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fd022ec00) 00010000:00010000:2.0:1786400920.680248:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1786400920.680251:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1df8b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.680257:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1df8b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.680274:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1df7d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.680279:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1df7d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.680284:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1df7d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.680288:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5c000 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400920.680290:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1df7d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.680295:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1df7d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.680301:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d6fd022e000) 00010000:00010000:2.0:1786400920.680303:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400920.680306:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1df7d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.680311:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1df7d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786400920.680521:0:5789:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e6b5b48a reply state 00000000b287597f transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1df84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400920.680532:0:5789:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786400920.680616:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd61d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+32:10487:x1873176850120064:12345-192.168.204.8@tcp:36:rm.0 Request processed in 2412us (2807us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1786400920.680624:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 95 00010000:00010000:2.0:1786400920.680653:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400920.680657:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1df92 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.680663:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5cc00 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:2.0:1786400920.680666:0:5776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1df92 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.680673:0:5776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1df92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.680681:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9d6fd022ec00) 00010000:00010000:2.0:1786400920.680684:0:5776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786400920.680687:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1df92 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.680691:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5cc00/0x5ccaaf4f3cb1df92 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.680704:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400920.680707:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400920.680708:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400920.682687:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1df84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.682710:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1df84 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.682718:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1df84 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.682724:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5d600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400920.682729:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1df84 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.682736:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1df84 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.682749:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d6fd022e900) 00010000:00010000:2.0:1786400920.682752:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400920.682756:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1df84 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.682762:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d600/0x5ccaaf4f3cb1df84 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786400920.687732:0:7501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:2.0:1786400920.687998:0:7501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1786400920.688011:0:7501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:0.0:1786400920.688014:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d7000dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+9:2362:x1873176850119296:12345-192.168.204.8@tcp:16:kworker.0 Request processed in 59168us (60421us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400920.688027:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 34 00000100:00100000:2.0:1786400920.748514:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400920.748627:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850120320 00000100:00100000:3.0:1786400920.748638:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850120320 00000100:00100000:3.0:1786400920.748770:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 96 00000100:00100000:3.0:1786400920.748782:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+31:10493:x1873176850120320:12345-192.168.204.8@tcp:101:bash.0 00010000:00010000:3.0:1786400920.748806:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400920.748829:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1df99 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bc68 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.748986:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1dfa0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.749002:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1dfa0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.749014:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1dfa0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.749029:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1dfa7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.749035:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1dfa7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.749042:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1dfa7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1786400920.749655:0:5790:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1786400920.749823:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1dfae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.749834:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1dfae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.749843:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1dfae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.749878:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1dfa0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.749895:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1dfa0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.749902:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1dfa0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.749908:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7d39600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786400920.749912:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1dfa0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.749919:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1dfa0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.749932:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d6fd022e000) 00010000:00010000:3.0:1786400920.749935:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400920.749940:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1dfa0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.749946:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1dfa0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786400920.749960:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000020bdf5 reply state 000000007908c8f2 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1dfa7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400920.749969:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1786400920.749996:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1df99 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc68 expref: 34 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.750010:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1dfae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc68 expref: 33 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.750028:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d6fc5599a00) 00010000:00010000:3.0:1786400920.750031:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786400920.750034:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7d38e00, rc 0) 00000100:00100000:3.0:1786400920.750167:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+34:10493:x1873176850120320:12345-192.168.204.8@tcp:101:bash.0 Request processed in 1387us (1662us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1786400920.750176:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 96 00010000:00010000:1.0:1786400920.754077:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1dfa7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400920.754762:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1dfa7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400920.754770:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1dfa7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400920.754775:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7d38400 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400920.754780:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1dfa7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400920.754788:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1dfa7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400920.754827:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d6fc5599100) 00010000:00010000:1.0:1786400920.754831:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400920.754835:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1dfa7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400920.754841:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1dfa7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400920.758516:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400920.758979:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850120448 00000100:00100000:0.0:1786400920.758989:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850120448 00000100:00100000:0.0:1786400920.759119:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 35 00000100:00100000:0.0:1786400920.759130:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+5:2364:x1873176850120448:12345-192.168.204.8@tcp:101:bash.0 00010000:00010000:0.0:1786400920.759147:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400920.759183:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074c3fdff/0x5ccaaf4f3cb1dfbc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bc6f expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786400920.759224:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1786400920.759243:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=373s v=(0 0) 00010000:00010000:0.0:1786400920.759248:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786400920.759259:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074c3fdff/0x5ccaaf4f3cb1dfbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc6f expref: 6 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.759281:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000074c3fdff/0x5ccaaf4f3cb1dfbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc6f expref: 6 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.759296:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5aa400, rc 0) 00000100:00100000:0.0:1786400920.759351:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+6:2364:x1873176850120448:12345-192.168.204.8@tcp:101:bash.0 Request processed in 222us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400920.759359:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 35 00000100:00100000:0.0:1786400920.764347:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400920.764447:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850120576 00000100:00100000:3.0:1786400920.764457:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850120576 00000100:00100000:3.0:1786400920.764536:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 36 00000100:00100000:3.0:1786400920.764548:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd61dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+6:10493:x1873176850120576:12345-192.168.204.8@tcp:101:bash.0 00010000:00010000:3.0:1786400920.764569:0:6593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400920.764591:0:6593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5459cc9/0x5ccaaf4f3cb1dfc3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bc76 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.764626:0:6593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000074c3fdff/0x5ccaaf4f3cb1dfbc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc6f expref: 7 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.764635:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400920.764639:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400920.764658:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5459cc9/0x5ccaaf4f3cb1dfc3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc76 expref: 7 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.764696:0:6593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000074c3fdff/0x5ccaaf4f3cb1dfbc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc6f expref: 7 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.764729:0:6593:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000074c3fdff/0x5ccaaf4f3cb1dfbc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc6f expref: 7 pid: 6590 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400920.764742:0:6593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd5bad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6593:1873176872155648:192.168.204.8@tcp:104: 00000100:00100000:3.0:1786400920.764839:0:6593:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffccb7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1786400920.770371:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400920.770927:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850120704 00000100:00100000:1.0:1786400920.770937:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850120704 00010000:00010000:1.0:1786400920.770982:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000074c3fdff/0x5ccaaf4f3cb1dfbc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc6f expref: 8 pid: 6590 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400920.771229:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 49 00000100:00100000:1.0:1786400920.771241:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc458b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096c63d9-38b8-441b-8c71-343db25fe88a+8:2364:x1873176850120704:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400920.771258:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400920.771281:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000074c3fdff/0x5ccaaf4f3cb1dfbc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc6f expref: 8 pid: 6590 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400920.771296:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000074c3fdff/0x5ccaaf4f3cb1dfbc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc6f expref: 8 pid: 6590 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400920.771323:0:5773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786400920.771327:0:5773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786400920.771335:0:5773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5459cc9/0x5ccaaf4f3cb1dfc3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc76 expref: 8 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400920.771361:0:5773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5459cc9/0x5ccaaf4f3cb1dfc3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc76 expref: 8 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400920.771639:0:5773:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a5459cc9/0x5ccaaf4f3cb1dfc3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc76 expref: 8 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400920.772301:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5fbe680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5773:1873176872155776:192.168.204.8@tcp:105: 00000100:00100000:1.0:1786400920.772390:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc4e18240 going to sleep for 11 seconds 00010000:00010000:3.0:1786400920.773303:0:6593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074c3fdff/0x5ccaaf4f3cb1dfbc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc6f expref: 8 pid: 6590 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400920.773324:0:6593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd5bad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6593:1873176872155648:192.168.204.8@tcp:104: 00010000:00010000:3.0:1786400920.773359:0:6593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5459cc9/0x5ccaaf4f3cb1dfc3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc76 expref: 7 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.773378:0:6593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7d38a00, rc 0) 00000100:00100000:3.0:1786400920.773426:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd61dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+7:10493:x1873176850120576:12345-192.168.204.8@tcp:101:bash.0 Request processed in 8881us (9087us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400920.773436:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 36 00000100:00100000:1.0:1786400920.780641:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5fbe680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5773:1873176872155776:192.168.204.8@tcp:105: 00010000:00010000:1.0:1786400920.780681:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400920.783759:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc458b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096c63d9-38b8-441b-8c71-343db25fe88a+6:2364:x1873176850120704:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 12505us (13386us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400920.783775:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 49 00000100:00100000:0.0:1786400920.785779:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400920.785996:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850120960 00000100:00100000:1.0:1786400920.786008:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850120960 00000100:00100000:1.0:1786400920.786144:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 25 00000100:00100000:1.0:1786400920.786154:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd61ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+33:10493:x1873176850120960:12345-192.168.204.8@tcp:35:bash.0 00000100:00100000:1.0:1786400920.786549:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd61ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+34:10493:x1873176850120960:12345-192.168.204.8@tcp:35:bash.0 Request processed in 396us (779us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1786400920.786559:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 25 00000040:00080000:0.0:1786400920.878723:0:11546:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786400920.878732:0:11546:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786400920.878768:0:11546:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1786400920.878776:0:11546:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786400920.972035:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400920.972248:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850121088 00000100:00100000:3.0:1786400920.972263:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850121088 00000100:00100000:3.0:1786400920.972344:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 97 00000100:00100000:3.0:1786400920.972355:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd61d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+34:10509:x1873176850121088:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:3.0:1786400920.972388:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400920.972415:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1dfca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bc7d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.972711:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1dfd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.972728:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1dfd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.972743:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1dfd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400920.972828:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1786400920.972833:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1786400920.972860:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1dfd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.972891:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1dfca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc7d expref: 36 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.972916:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1dfd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc7d expref: 35 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.972926:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d6fd022e000) 00010000:00010000:3.0:1786400920.972930:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786400920.972936:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7d38400, rc 0) 00000100:00100000:3.0:1786400920.973485:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd61d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+35:10509:x1873176850121088:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 1118us (1529us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400920.973495:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 97 00000100:00100000:2.0:1786400920.978871:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400920.979080:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850121344 00000100:00100000:0.0:1786400920.979124:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850121344 00000100:00100000:0.0:1786400920.979216:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 98 00000100:00100000:0.0:1786400920.979229:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+35:10509:x1873176850121344:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:0.0:1786400920.979279:0:6615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400920.979307:0:6615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1dfd8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bc84 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.979735:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1dfdf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.979753:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1dfdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.979769:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1dfdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400920.979782:0:6615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1786400920.980058:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1dfd8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc84 expref: 38 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.980141:0:6615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1dfdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc84 expref: 37 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400920.980153:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d6fc5599a00) 00010000:00010000:0.0:1786400920.980156:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786400920.980160:0:6615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5aac00, rc 0) 00000100:00100000:0.0:1786400920.980462:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+37:10509:x1873176850121344:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 1234us (1601us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1786400920.980483:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 98 00000100:00100000:0.0:1786400920.985696:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400920.986127:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850121472 00000100:00100000:3.0:1786400920.986141:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850121472 00000100:00100000:3.0:1786400920.987825:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 6 00000100:00100000:3.0:1786400920.987859:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd61f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096c63d9-38b8-441b-8c71-343db25fe88a+37:2365:x1873176850121472:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786400920.987886:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400920.987921:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1dfdf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc84 expref: 37 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400920.987948:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d6fc5599a00) 00010000:00010000:3.0:1786400920.987967:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400920.988058:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd61f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096c63d9-38b8-441b-8c71-343db25fe88a+36:2365:x1873176850121472:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 215us (2381us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400920.988505:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400920.989051:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850121728 00000100:00100000:2.0:1786400920.989065:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850121728 00000100:00100000:2.0:1786400920.989203:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 99 00000100:00100000:2.0:1786400920.989215:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd61ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+37:10509:x1873176850121728:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:2.0:1786400920.989246:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400920.989269:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bae00/0x5ccaaf4f3cb1dfed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bc8b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.990036:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba000/0x5ccaaf4f3cb1dff4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.990059:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba000/0x5ccaaf4f3cb1dff4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.990074:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba000/0x5ccaaf4f3cb1dff4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400920.990116:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1786400920.990358:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bae00/0x5ccaaf4f3cb1dfed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc8b expref: 40 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.990453:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba000/0x5ccaaf4f3cb1dff4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc8b expref: 39 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400920.990463:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d6fc5599a00) 00010000:00010000:2.0:1786400920.990467:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1786400920.990471:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fee1ba000, rc 0) 00000100:00100000:2.0:1786400920.990563:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd61ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+39:10509:x1873176850121728:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 1350us (2058us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1786400920.990572:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 99 00000100:00100000:3.0:1786400920.992705:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 6 00000100:00100000:0.0:1786400920.997852:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400920.998075:0:11770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850121856 00000100:00100000:1.0:1786400920.998126:0:11770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850121856 00000100:00100000:1.0:1786400920.998243:0:11770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 37 00000100:00100000:1.0:1786400920.998256:0:11770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd61c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:096c63d9-38b8-441b-8c71-343db25fe88a+6:2363:x1873176850121856:12345-192.168.204.8@tcp:1:lfs.0 00010000:00010000:1.0:1786400920.998322:0:11770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fff4c76c/0x5ccaaf4f3cb1e002 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400920.998348:0:11770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5459cc9/0x5ccaaf4f3cb1dfc3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc76 expref: 6 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400920.998358:0:11770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786400920.998362:0:11770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786400920.998380:0:11770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fff4c76c/0x5ccaaf4f3cb1e002 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400920.998424:0:11770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a5459cc9/0x5ccaaf4f3cb1dfc3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc76 expref: 6 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400920.998441:0:11770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a5459cc9/0x5ccaaf4f3cb1dfc3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc76 expref: 6 pid: 6593 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400920.998459:0:11770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5fbe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11770:1873176872155904:192.168.204.8@tcp:104: 00000100:00100000:1.0:1786400920.998598:0:11770:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc4e18300 going to sleep for 11 seconds 00000100:00100000:2.0:1786400921.002720:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400921.002837:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850121984 00000100:00100000:3.0:1786400921.002850:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850121984 00002000:00100000:3.0:1786400921.002935:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9d6ffd002a00 x1873176850121984/t0(0) o4->096c63d9-38b8-441b-8c71-343db25fe88a@192.168.204.8@tcp:717/0 lens 504/0 e 0 to 0 dl 1786400932 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786400921.002948:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ffd002a00 with x1873176850121984 ext(0->8) 00000100:00080000:2.0:1786400921.003037:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786400921.003078:0:6596:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a5459cc9/0x5ccaaf4f3cb1dfc3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc76 expref: 7 pid: 6593 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.003138:0:6596:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a5459cc9/0x5ccaaf4f3cb1dfc3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc76 expref: 7 pid: 6593 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786400921.003148:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9d6ffd002a00 00000100:00100000:3.0:1786400921.003182:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1 00000100:00100000:3.0:1786400921.003211:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd002a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:096c63d9-38b8-441b-8c71-343db25fe88a+7:2364:x1873176850121984:12345-192.168.204.8@tcp:4:lfs.0 00000100:00100000:3.0:1786400921.003862:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd002a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:096c63d9-38b8-441b-8c71-343db25fe88a+9:2364:x1873176850121984:12345-192.168.204.8@tcp:4:lfs.0 Request processed in 666us (1155us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1786400921.003880:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1 00002000:00100000:3.0:1786400921.003893:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9d6ffd002a00 x1873176850121984/t4294967302(0) o4->096c63d9-38b8-441b-8c71-343db25fe88a@192.168.204.8@tcp:717/0 lens 504/448 e 0 to 0 dl 1786400932 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786400921.003904:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ffd002a00 with x1873176850121984 ext(0->8) 00010000:00010000:3.0:1786400921.003912:0:6596:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a5459cc9/0x5ccaaf4f3cb1dfc3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc76 expref: 9 pid: 6593 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.003928:0:6596:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a5459cc9/0x5ccaaf4f3cb1dfc3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc76 expref: 9 pid: 6593 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786400921.003936:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9d6ffd002a00 00000100:00100000:1.0:1786400921.005896:0:11770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5fbe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11770:1873176872155904:192.168.204.8@tcp:104: 00010000:00010000:1.0:1786400921.005935:0:11770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fff4c76c/0x5ccaaf4f3cb1e002 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400921.007969:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400921.008663:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850122112 00000100:00100000:1.0:1786400921.008678:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850122112 00010000:00010000:1.0:1786400921.008734:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a5459cc9/0x5ccaaf4f3cb1dfc3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc76 expref: 9 pid: 6593 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400921.008844:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 50 00000100:00100000:1.0:1786400921.008857:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd000000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096c63d9-38b8-441b-8c71-343db25fe88a+9:2362:x1873176850122112:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400921.008878:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1786400921.008900:0:5774:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1786400921.008904:0:5774:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1786400919 00002000:00010000:1.0:1786400921.008907:0:5774:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1786400919 00002000:00010000:1.0:1786400921.008909:0:5774:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1786400919 00010000:00010000:1.0:1786400921.008915:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a5459cc9/0x5ccaaf4f3cb1dfc3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc76 expref: 9 pid: 6593 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.008933:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a5459cc9/0x5ccaaf4f3cb1dfc3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc76 expref: 9 pid: 6593 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.009038:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5459cc9/0x5ccaaf4f3cb1dfc3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc76 expref: 9 pid: 6593 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.009057:0:5774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786400921.009062:0:5774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786400921.009070:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fff4c76c/0x5ccaaf4f3cb1e002 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.009081:0:5774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fff4c76c/0x5ccaaf4f3cb1e002 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.009150:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400921.009243:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd000000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096c63d9-38b8-441b-8c71-343db25fe88a+8:2362:x1873176850122112:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 388us (1299us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400921.009253:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 50 00010000:00010000:3.0:1786400921.009256:0:11770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fff4c76c/0x5ccaaf4f3cb1e002 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.009269:0:11770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fff4c76c/0x5ccaaf4f3cb1e002 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.009384:0:11770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fff4c76c/0x5ccaaf4f3cb1e002 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.009394:0:11770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fff4c76c/0x5ccaaf4f3cb1e002 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.009402:0:11770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fff4c76c/0x5ccaaf4f3cb1e002 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.009421:0:11770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138f400 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:3.0:1786400921.009426:0:11770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fff4c76c/0x5ccaaf4f3cb1e002 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.009435:0:11770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fff4c76c/0x5ccaaf4f3cb1e002 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.009449:0:11770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fff4c76c/0x5ccaaf4f3cb1e002 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.009456:0:11770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fff4c76c/0x5ccaaf4f3cb1e002 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400921.010031:0:11770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd61c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:096c63d9-38b8-441b-8c71-343db25fe88a+7:2363:x1873176850121856:12345-192.168.204.8@tcp:1:lfs.0 Request processed in 11772us (12189us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400921.010044:0:11770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 37 00000100:00100000:2.0:1786400921.012370:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400921.012526:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850122368 00000100:00100000:0.0:1786400921.012541:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850122368 00000100:00080000:2.0:1786400921.012899:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400921.013418:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 26 00000100:00100000:0.0:1786400921.013434:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6d7d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+38:10509:x1873176850122368:12345-192.168.204.8@tcp:35:lfs.0 00000004:00010000:0.0:1786400921.016748:0:5791:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba000/0x5ccaaf4f3cb1dff4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc8b expref: 38 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786400921.017380:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1786400921.017518:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1786400921.017923:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1786400921.017998:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e009 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.018019:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1dfae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc68 expref: 42 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.018029:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e009 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.018143:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1dfae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc68 expref: 42 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.018171:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1dfae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc68 expref: 42 pid: 5790 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400921.018186:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd61c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5791:1873176872156032:192.168.204.8@tcp:104: 00000100:00100000:0.0:1786400921.018535:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fee1f30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786400921.024051:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400921.024268:0:8369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850122496 00000100:00100000:2.0:1786400921.024283:0:8369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850122496 00010000:00010000:2.0:1786400921.024342:0:8369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1dfae lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc68 expref: 43 pid: 5790 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400921.024377:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd61c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5791:1873176872156032:192.168.204.8@tcp:104: 00010000:00010000:0.0:1786400921.024413:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e009 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400921.024433:0:8369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 51 00000100:00100000:2.0:1786400921.024444:0:8369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5fbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+43:2365:x1873176850122496:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786400921.024463:0:8369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400921.024483:0:8369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1dfae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc68 expref: 43 pid: 5790 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.024498:0:8369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1dfae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc68 expref: 43 pid: 5790 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.024525:0:8369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1dfae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc68 expref: 43 pid: 5790 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.024545:0:8369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d6fc5599a00) 00010000:00010000:2.0:1786400921.024551:0:8369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e009 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.024575:0:8369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e009 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.024585:0:8369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e009 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.024627:0:8369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400921.026433:0:8369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5fbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+42:2365:x1873176850122496:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 1975us (3367us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400921.026453:0:8369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 51 00010000:00010000:0.0:1786400921.026743:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e009 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.026757:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e009 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786400921.026934:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1786400921.027298:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1786400921.027792:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd61c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5791:1873176872156160:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1786400921.029461:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400921.029543:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc9c7ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1786400921.031520:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872156160 00000100:00100000:3.0:1786400921.031540:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872156160 00000100:00080000:2.0:1786400921.031828:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786400921.032014:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1786400921.032032:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd61e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5791:x1873176872156160:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1786400921.032658:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd61c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5791:1873176872156160:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1786400921.032861:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd61e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5791:x1873176872156160:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 191us (2764us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400921.032871:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000001:00080000:0.0:1786400921.035169:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1786400921.035401:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd61c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5791:1873176872156288:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1786400921.035522:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400921.035564:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffd5b1840 going to sleep for 11 seconds 00000100:00100000:3.0:1786400921.035597:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872156288 00000100:00100000:3.0:1786400921.035605:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872156288 00000100:00100000:3.0:1786400921.035664:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1786400921.035675:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5791:x1873176872156288:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1786400921.035894:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5791:x1873176872156288:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 221us (372us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1786400921.035903:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1786400921.035980:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd61c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5791:1873176872156288:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1786400921.036046:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1786400921.036188:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e009 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.036200:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e009 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.036209:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e009 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.036215:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aa400 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400921.036229:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e009 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.036622:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e009 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.036641:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d6fc5599a00) 00010000:00010000:0.0:1786400921.036644:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1786400921.036649:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e009 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.036656:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e009 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786400921.037341:0:5791:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1786400921.037446:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1786400921.037457:0:5791:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 373438369623ns, next at 374438367808ns, rc = 0 00000001:00080000:0.0:1786400921.037464:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1786400921.037520:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d6fc5599a00) 00010000:00010000:0.0:1786400921.037524:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1786400921.037531:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba000/0x5ccaaf4f3cb1dff4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc8b expref: 46 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400921.037653:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6d7d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+45:10509:x1873176850122368:12345-192.168.204.8@tcp:35:lfs.0 Request processed in 24224us (25297us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1786400921.037663:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 26 00000020:00080000:0.0:1786400921.037668:0:5791:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1786400921.043439:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400921.043598:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850122624 00000100:00100000:3.0:1786400921.043608:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850122624 00000100:00100000:3.0:1786400921.044424:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 100 00000100:00100000:3.0:1786400921.044440:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+45:10509:x1873176850122624:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:3.0:1786400921.044492:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400921.044516:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1e010 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bc92 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.044577:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1e010 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc92 expref: 46 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.044591:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1e010 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc92 expref: 46 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.044610:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d6fc5599c00) 00010000:00010000:3.0:1786400921.044613:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786400921.044616:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7d38000, rc 0) 00000100:00100000:3.0:1786400921.044689:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+46:10509:x1873176850122624:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 254us (1259us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400921.044697:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 100 00000100:00100000:3.0:1786400921.051286:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400921.051835:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850122880 00000100:00100000:1.0:1786400921.051847:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850122880 00000100:00100000:1.0:1786400921.052013:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 27 00000100:00100000:1.0:1786400921.052025:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd5bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+46:10509:x1873176850122880:12345-192.168.204.8@tcp:35:lfs.0 00000100:00100000:1.0:1786400921.052879:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd5bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+47:10509:x1873176850122880:12345-192.168.204.8@tcp:35:lfs.0 Request processed in 853us (1600us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1786400921.052888:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 27 00000100:00100000:2.0:1786400921.117201:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400921.117356:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850123008 00000100:00100000:0.0:1786400921.117369:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850123008 00000100:00100000:0.0:1786400921.117441:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 101 00000100:00100000:0.0:1786400921.117453:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd001f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+47:10519:x1873176850123008:12345-192.168.204.8@tcp:34:lfs.0 00010000:00010000:0.0:1786400921.117599:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e017 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.117621:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e017 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.117634:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e017 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.117650:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e01e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.117658:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e01e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.117665:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e01e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.117769:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e025 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.117777:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e025 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.117784:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e025 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786400921.117829:0:5789:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e025 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.117842:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e017 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.117859:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e017 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.117866:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e017 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.117873:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aa400 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400921.117877:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e017 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.117885:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e017 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.117897:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d6fd022e000) 00010000:00010000:0.0:1786400921.117900:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400921.117905:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e017 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.117911:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e017 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.117925:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e01e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.117930:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e01e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.117935:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e01e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.117940:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aa200 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400921.117949:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e01e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.117955:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e01e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.117963:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d6fc90cdd00) 00010000:00010000:0.0:1786400921.117966:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400921.117969:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e01e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.117974:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e01e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.117990:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e025 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.117997:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e025 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.118003:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e025 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.118008:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5ab800 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400921.118011:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e025 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.118018:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e025 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.118025:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d6fc5599c00) 00010000:00010000:0.0:1786400921.118028:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400921.118037:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e025 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.118043:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e025 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400921.120008:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd001f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+47:10519:x1873176850123008:12345-192.168.204.8@tcp:34:lfs.0 Request processed in 2548us (2811us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400921.120023:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 101 00000100:00100000:2.0:1786400921.169872:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400921.170325:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850123264 00000100:00100000:0.0:1786400921.170334:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850123264 00000100:00100000:0.0:1786400921.170455:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 102 00000100:00100000:0.0:1786400921.170464:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd003b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+47:10522:x1873176850123264:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:0.0:1786400921.170515:0:6615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400921.170540:0:6615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e02c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bc99 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.170697:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e033 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.170714:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e033 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.170725:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e033 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.170741:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e03a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.170748:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e03a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.170754:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e03a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.170914:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e041 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.170922:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.170929:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400921.170939:0:6615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1786400921.171052:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e033 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.171060:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e033 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.171067:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e033 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.171073:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aa200 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400921.171077:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e033 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.171254:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e033 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.171270:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d6fd022e000) 00010000:00010000:0.0:1786400921.171273:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400921.171279:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e033 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.171298:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e033 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.171313:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e03a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.171319:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e03a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.171324:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e03a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.171329:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aa400 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400921.171332:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e03a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.171338:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e03a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.171346:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d6fc90cdd00) 00010000:00010000:0.0:1786400921.171349:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400921.171351:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e03a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.171357:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e03a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.171401:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e02c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc99 expref: 50 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.171416:0:6615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e041 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc99 expref: 49 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.171430:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d6fc5599c00) 00010000:00010000:0.0:1786400921.171432:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786400921.171435:0:6615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5ab200, rc 0) 00000100:00100000:0.0:1786400921.171621:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd003b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+49:10522:x1873176850123264:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 1156us (1758us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1786400921.171639:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 102 00000100:00100000:3.0:1786400921.177866:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400921.178005:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850123392 00000100:00100000:0.0:1786400921.178016:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850123392 00000100:00100000:0.0:1786400921.178080:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 103 00000100:00100000:0.0:1786400921.178125:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd5bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+49:10522:x1873176850123392:12345-192.168.204.8@tcp:54:lfs.0 00010000:00010000:0.0:1786400921.178623:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e04f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.178642:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e04f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.178656:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e04f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.178690:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e04f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.178698:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e04f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.178704:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e04f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.178710:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5ab800 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400921.178730:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e04f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.178738:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e04f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.178750:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d6fc5599c00) 00010000:00010000:0.0:1786400921.178753:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786400921.178757:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e04f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.178764:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e04f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400921.178960:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd5bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+49:10522:x1873176850123392:12345-192.168.204.8@tcp:54:lfs.0 Request processed in 836us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400921.178969:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 103 00000100:00100000:2.0:1786400921.181979:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400921.182275:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850123648 00000100:00100000:0.0:1786400921.182286:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850123648 00000100:00100000:0.0:1786400921.182339:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 28 00000100:00100000:0.0:1786400921.182347:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+49:10522:x1873176850123648:12345-192.168.204.8@tcp:35:lfs.0 00000100:00100000:0.0:1786400921.183036:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+50:10522:x1873176850123648:12345-192.168.204.8@tcp:35:lfs.0 Request processed in 687us (1065us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1786400921.183045:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 28 00000100:00100000:2.0:1786400921.255944:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400921.256167:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850123904 00000100:00100000:3.0:1786400921.256178:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850123904 00000100:00100000:3.0:1786400921.256931:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 104 00000100:00100000:3.0:1786400921.256947:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd002680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+50:10532:x1873176850123904:12345-192.168.204.8@tcp:101:bash.0 00010000:00010000:3.0:1786400921.256975:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400921.256979:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1786400921.257009:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1dfd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc7d expref: 50 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.257049:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d6fd022e000) 00010000:00010000:3.0:1786400921.257055:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786400921.257070:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1e056 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bca0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.257241:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1e05d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.257255:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e041 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc99 expref: 50 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.257263:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1e05d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.257298:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e041 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc99 expref: 50 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.257311:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e041 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc99 expref: 50 pid: 6615 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400921.257324:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd9f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5790:1873176872156416:192.168.204.8@tcp:104: 00000100:00100000:3.0:1786400921.260230:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffccb7000 going to sleep for 11 seconds 00000100:00100000:0.0:1786400921.265452:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd9f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5790:1873176872156416:192.168.204.8@tcp:104: 00010000:00010000:0.0:1786400921.265509:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1e05d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400921.267065:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400921.267185:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850124032 00000100:00100000:1.0:1786400921.267203:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850124032 00010000:00010000:1.0:1786400921.267271:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e041 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc99 expref: 51 pid: 6615 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400921.267842:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 52 00000100:00100000:2.0:1786400921.267860:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096c63d9-38b8-441b-8c71-343db25fe88a+51:2364:x1873176850124032:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786400921.267881:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400921.267892:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e041 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc99 expref: 51 pid: 6615 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.267926:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e041 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc99 expref: 51 pid: 6615 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.267965:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e041 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc99 expref: 51 pid: 6615 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.268008:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d6fc5599c00) 00010000:00010000:2.0:1786400921.268013:0:5774:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1e05d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.268024:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1e05d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.268033:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1e05d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.268073:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786400921.268126:0:5790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1e05d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.268144:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1e05d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400921.268171:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00000100:00100000:2.0:1786400921.268205:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096c63d9-38b8-441b-8c71-343db25fe88a+50:2364:x1873176850124032:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 350us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400921.268215:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 52 00010000:00010000:0.0:1786400921.268391:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1e056 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bca0 expref: 51 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.268411:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1e05d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bca0 expref: 50 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.268419:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d6fc5599c00) 00010000:00010000:0.0:1786400921.268422:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1786400921.268425:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7d38e00, rc 0) 00000100:00100000:0.0:1786400921.268455:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd002680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+50:10532:x1873176850123904:12345-192.168.204.8@tcp:101:bash.0 Request processed in 11514us (12520us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1786400921.268463:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 104 00000100:00100000:3.0:1786400921.272684:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400921.272828:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850124288 00000100:00100000:1.0:1786400921.272843:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850124288 00000100:00100000:1.0:1786400921.273019:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 105 00000100:00100000:1.0:1786400921.273032:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd9f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+50:10532:x1873176850124288:12345-192.168.204.8@tcp:36:bash.0 00010000:00010000:1.0:1786400921.273542:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e06b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.273565:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e06b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.273580:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e06b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786400921.273803:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1786400921.273833:0:5789:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000091cfacc2 reply state 0000000000e2a452 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e06b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400921.273843:0:5789:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786400921.274135:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd9f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+53:10532:x1873176850124288:12345-192.168.204.8@tcp:36:bash.0 Request processed in 1102us (1463us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1786400921.274145:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 105 00000020:00080000:1.0:1786400921.274153:0:5789:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1786400921.276812:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e06b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.276835:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e06b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.276844:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e06b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.276850:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138f200 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400921.276855:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e06b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.276864:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e06b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.277435:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d6fc5599c00) 00010000:00010000:2.0:1786400921.277441:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400921.277447:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e06b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.277458:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e06b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400921.277854:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400921.278150:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850124416 00000100:00100000:0.0:1786400921.278163:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850124416 00000100:00100000:0.0:1786400921.278410:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 106 00000100:00100000:0.0:1786400921.278422:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd9f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+52:10532:x1873176850124416:12345-192.168.204.8@tcp:101:bash.0 00010000:00010000:0.0:1786400921.278456:0:6615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400921.278489:0:6615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e072 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bca7 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.278600:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e079 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.278638:0:6615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1e05d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bca0 expref: 53 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.278648:0:6615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e079 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.278696:0:6615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1e05d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bca0 expref: 53 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.278711:0:6615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1e05d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bca0 expref: 53 pid: 5790 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400921.278861:0:6615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdbc1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6615:1873176872156544:192.168.204.8@tcp:104: 00000100:00100000:0.0:1786400921.278998:0:6615:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffd5b1780 going to sleep for 11 seconds 00000100:00100000:0.0:1786400921.282437:0:6615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdbc1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6615:1873176872156544:192.168.204.8@tcp:104: 00010000:00010000:0.0:1786400921.282486:0:6615:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e079 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400921.282748:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400921.282976:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850124544 00000100:00100000:1.0:1786400921.282987:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850124544 00010000:00010000:1.0:1786400921.283033:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1e05d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bca0 expref: 54 pid: 5790 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400921.283664:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 53 00000100:00100000:1.0:1786400921.283680:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc926a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096c63d9-38b8-441b-8c71-343db25fe88a+54:2365:x1873176850124544:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400921.283701:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400921.283710:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1e05d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bca0 expref: 54 pid: 5790 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.283745:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1e05d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bca0 expref: 54 pid: 5790 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.283774:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1e05d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bca0 expref: 54 pid: 5790 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.283796:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d6fc5599c00) 00010000:00010000:1.0:1786400921.283803:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e079 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.283815:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e079 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.283824:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e079 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.283861:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400921.284236:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc926a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096c63d9-38b8-441b-8c71-343db25fe88a+53:2365:x1873176850124544:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 558us (1487us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400921.284316:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 53 00010000:00010000:0.0:1786400921.284662:0:6615:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e079 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.284672:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e079 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400921.284736:0:6615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1786400921.284741:0:6615:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786400921.284768:0:6615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e079 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.284832:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e072 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bca7 expref: 53 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.284936:0:6615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e079 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bca7 expref: 52 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.284946:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d6fc5599c00) 00010000:00010000:0.0:1786400921.284949:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786400921.284952:0:6615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5aa400, rc 0) 00000100:00100000:0.0:1786400921.285523:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd9f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+52:10532:x1873176850124416:12345-192.168.204.8@tcp:101:bash.0 Request processed in 7086us (7659us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400921.285534:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 106 00000100:00100000:3.0:1786400921.289801:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400921.290336:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850124800 00000100:00100000:2.0:1786400921.290349:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850124800 00000100:00100000:2.0:1786400921.290425:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 29 00000100:00100000:2.0:1786400921.290437:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9269500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+52:10532:x1873176850124800:12345-192.168.204.8@tcp:35:bash.0 00000100:00100000:2.0:1786400921.290987:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9269500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+53:10532:x1873176850124800:12345-192.168.204.8@tcp:35:bash.0 Request processed in 549us (1201us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1786400921.290998:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 29 00000100:00100000:3.0:1786400921.371508:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400921.371757:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850124928 00000100:00100000:1.0:1786400921.371771:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850124928 00000100:00100000:1.0:1786400921.371851:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 107 00000100:00100000:1.0:1786400921.371862:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+53:10538:x1873176850124928:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:1.0:1786400921.371897:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400921.371923:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1e080 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bcae expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.373147:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e087 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.373174:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.373188:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400921.373270:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1786400921.373274:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1786400921.373304:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.373346:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1e080 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcae expref: 55 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.373374:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e087 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcae expref: 54 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.373386:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d6fd022e000) 00010000:00010000:1.0:1786400921.373389:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786400921.373394:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138e600, rc 0) 00000100:00100000:1.0:1786400921.373507:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+54:10538:x1873176850124928:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 1645us (2013us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400921.373518:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 107 00000100:00100000:2.0:1786400921.380701:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400921.380816:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850125056 00000100:00100000:3.0:1786400921.380829:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850125056 00000100:00100000:3.0:1786400921.380937:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 108 00000100:00100000:3.0:1786400921.380950:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+54:10538:x1873176850125056:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:3.0:1786400921.380978:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400921.381007:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1e08e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bcb5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.381124:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1e095 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.381141:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1e095 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.381154:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1e095 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.381296:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1e09c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.381306:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1e09c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.381313:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1e09c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.381608:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1e0a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.381619:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1e0a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.381648:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1e0a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400921.381700:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1786400921.381705:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786400921.381729:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1e0a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.381744:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1e0a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.381754:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1e095 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.381762:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1e095 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.381769:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1e095 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.381776:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7d38400 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786400921.381781:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1e095 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.381790:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1e095 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.381805:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d6fd022e000) 00010000:00010000:3.0:1786400921.381808:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400921.381814:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1e095 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.381833:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38400/0x5ccaaf4f3cb1e095 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.381852:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1e09c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.381858:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1e09c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.381863:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1e09c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.381869:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7d38e00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786400921.381872:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1e09c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.381878:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1e09c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.381886:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d6fc5599000) 00010000:00010000:3.0:1786400921.381889:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400921.381892:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1e09c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.381897:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38e00/0x5ccaaf4f3cb1e09c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.381939:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38a00/0x5ccaaf4f3cb1e08e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcb5 expref: 56 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.381954:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1e0a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcb5 expref: 55 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.381969:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d6fc5599c00) 00010000:00010000:3.0:1786400921.381972:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786400921.381975:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7d39600, rc 0) 00000100:00100000:3.0:1786400921.382069:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+55:10538:x1873176850125056:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 1121us (1383us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400921.382078:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 108 00000100:00100000:1.0:1786400921.390512:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400921.390560:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400921.390604:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850125184 00000100:00100000:1.0:1786400921.390614:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850125184 00000100:00100000:1.0:1786400921.390679:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 7 00000100:00100000:3.0:1786400921.390684:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850125440 00000100:00100000:3.0:1786400921.390689:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850125440 00000100:00100000:3.0:1786400921.390857:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 109 00000100:00100000:3.0:1786400921.390869:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+56:10538:x1873176850125440:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:3.0:1786400921.390889:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400921.390910:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091a00/0x5ccaaf4f3cb1e0aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bcbc expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400921.390923:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096c63d9-38b8-441b-8c71-343db25fe88a+56:2364:x1873176850125184:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400921.390935:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400921.390957:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39600/0x5ccaaf4f3cb1e0a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcb5 expref: 57 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.390976:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d6fc5599c00) 00010000:00010000:1.0:1786400921.390982:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786400921.391025:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e0b1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.391042:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e079 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bca7 expref: 56 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.391053:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e0b1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400921.391053:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096c63d9-38b8-441b-8c71-343db25fe88a+56:2364:x1873176850125184:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 133us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400921.391069:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 7 00010000:00010000:3.0:1786400921.391121:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e079 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bca7 expref: 55 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.391138:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e079 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bca7 expref: 55 pid: 6615 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400921.391165:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc9ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5789:1873176872156672:192.168.204.8@tcp:104: 00000100:00100000:3.0:1786400921.391346:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffccb7540 going to sleep for 11 seconds 00000100:00100000:0.0:1786400921.398041:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400921.398137:0:8369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850125568 00000100:00100000:1.0:1786400921.398147:0:8369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850125568 00010000:00010000:1.0:1786400921.398183:0:8369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e079 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bca7 expref: 56 pid: 6615 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400921.398217:0:8369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 54 00000100:00100000:1.0:1786400921.398225:0:8369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4589c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+56:2365:x1873176850125568:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400921.398238:0:8369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400921.398245:0:8369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e079 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bca7 expref: 56 pid: 6615 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.398257:0:8369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e079 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bca7 expref: 56 pid: 6615 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400921.398291:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc9ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5789:1873176872156672:192.168.204.8@tcp:104: 00010000:00010000:1.0:1786400921.398296:0:8369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e079 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bca7 expref: 56 pid: 6615 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.398320:0:8369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d6fc5599c00) 00010000:00010000:3.0:1786400921.398322:0:5789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e0b1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.398326:0:8369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e0b1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.398343:0:8369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e0b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.398350:0:8369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e0b1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.399357:0:8369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400921.399422:0:8369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4589c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+55:2365:x1873176850125568:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 1194us (1389us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400921.399433:0:8369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 54 00010000:00010000:3.0:1786400921.399549:0:5789:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e0b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.399558:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e0b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400921.399579:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1786400921.400340:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091a00/0x5ccaaf4f3cb1e0aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcbc expref: 56 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.400363:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e0b1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcbc expref: 55 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400921.400371:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d6fc5599c00) 00010000:00010000:3.0:1786400921.400374:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1786400921.400377:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca091800, rc 0) 00000100:00100000:3.0:1786400921.401162:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+55:10538:x1873176850125440:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 10293us (10597us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1786400921.401172:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 109 00000001:00080000:2.0:1786400921.405366:0:6619:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:2.0:1786400921.405389:0:6619:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1786400921.405395:0:6619:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:0.0:1786400921.408916:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400921.409031:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850125824 00000100:00100000:2.0:1786400921.409041:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850125824 00000100:00100000:2.0:1786400921.409246:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 8 00000100:00100000:2.0:1786400921.409257:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096c63d9-38b8-441b-8c71-343db25fe88a+55:10538:x1873176850125824:12345-192.168.204.8@tcp:103:lfs.0 00010000:00010000:2.0:1786400921.409274:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400921.409304:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d38000/0x5ccaaf4f3cb1e010 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc92 expref: 55 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.409340:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d6fc5599c00) 00010000:00010000:2.0:1786400921.409345:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400921.409411:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096c63d9-38b8-441b-8c71-343db25fe88a+54:10538:x1873176850125824:12345-192.168.204.8@tcp:103:lfs.0 Request processed in 155us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400921.409417:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 8 00000100:00100000:0.0:1786400921.416295:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400921.416584:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850125952 00000100:00100000:2.0:1786400921.416593:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850125952 00000100:00100000:2.0:1786400921.417233:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 110 00000100:00100000:2.0:1786400921.417246:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+54:10538:x1873176850125952:12345-192.168.204.8@tcp:58:lfs.0 00010000:00010000:2.0:1786400921.417370:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba000/0x5ccaaf4f3cb1e0bf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.417388:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba000/0x5ccaaf4f3cb1e0bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.417401:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba000/0x5ccaaf4f3cb1e0bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786400921.417610:0:6615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1786400921.417688:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+54:10538:x1873176850125952:12345-192.168.204.8@tcp:58:lfs.0 Request processed in 445us (1404us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400921.417696:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 110 00000100:00100000:3.0:1786400921.421858:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400921.421994:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850126080 00000100:00100000:1.0:1786400921.422007:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850126080 00000100:00100000:1.0:1786400921.422222:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 111 00000100:00100000:1.0:1786400921.422236:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+54:10538:x1873176850126080:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:1.0:1786400921.422260:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400921.422285:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1e0c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bcc3 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.422356:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba000/0x5ccaaf4f3cb1e0bf lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.422379:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1e0c6 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcc3 expref: 55 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.422401:0:5788:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba000/0x5ccaaf4f3cb1e0bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.422415:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1e0c6 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcc3 expref: 55 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.422429:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d6fc5599c00) 00010000:00010000:1.0:1786400921.422432:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786400921.422436:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1e0c6 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcc3 expref: 55 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.422445:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138e400, rc 0) 00000100:00100000:1.0:1786400921.422515:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+55:10538:x1873176850126080:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 282us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400921.422523:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 111 00010000:00010000:0.0:1786400921.518681:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786400921.902370:0:11546:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786400921.902381:0:11546:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786400921.902593:0:11546:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1786400921.902600:0:11546:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786400921.902734:0:11546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdbc2d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11546:1873176872156800:192.168.204.8@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1786400921.902843:0:11546:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fe13c63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786400921.907287:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400921.907665:0:11546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdbc2d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11546:1873176872156800:192.168.204.8@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1786400921.908517:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850126208 00000100:00100000:1.0:1786400921.908530:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850126208 00000100:00100000:1.0:1786400921.908937:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 112 00000100:00100000:1.0:1786400921.908950:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+55:10539:x1873176850126208:12345-192.168.204.8@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1786400921.908995:0:5790:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1786400921.909153:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+55:10539:x1873176850126208:12345-192.168.204.8@tcp:53:lhsmtool_posix.0 Request processed in 205us (1881us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400921.909162:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 112 00000100:00100000:3.0:1786400921.917284:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400921.917447:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850126336 00000100:00100000:0.0:1786400921.917472:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850126336 00000100:00100000:0.0:1786400921.917605:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 113 00000100:00100000:0.0:1786400921.917638:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+55:10539:x1873176850126336:12345-192.168.204.8@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1786400921.917756:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e0cd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.917780:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e0cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.917798:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e0cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.919585:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e0d4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.919613:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e0d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.919627:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e0d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.919669:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e0db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.919679:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e0db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.919687:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e0db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400921.919740:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1786400921.919744:0:5789:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786400921.919759:0:5789:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e0db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.919795:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e0cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.919802:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e0cd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.919809:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e0cd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.919815:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aa600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400921.919819:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e0cd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.919828:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e0cd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.919842:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d6fc5599600) 00010000:00010000:0.0:1786400921.919846:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400921.919851:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e0cd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.919858:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e0cd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.919878:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e0d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.919885:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e0d4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.919891:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e0d4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.919902:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5ab600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400921.919906:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e0d4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.919912:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e0d4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.919920:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9d6fc90cdb00) 00010000:00010000:0.0:1786400921.919922:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400921.919926:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e0d4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.919931:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e0d4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.919948:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e0db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.919953:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e0db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.919958:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e0db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.919962:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aaa00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400921.919965:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e0db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.919970:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e0db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.919987:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d6fc5599c00) 00010000:00010000:0.0:1786400921.919989:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400921.919992:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e0db lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.919997:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e0db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400921.920151:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+55:10539:x1873176850126336:12345-192.168.204.8@tcp:34:lhsmtool_posix.0 Request processed in 2510us (2877us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400921.920165:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 113 00000100:00100000:0.0:1786400921.925977:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400921.926597:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850126592 00000100:00100000:2.0:1786400921.926607:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850126592 00000100:00100000:2.0:1786400921.926679:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 114 00000100:00100000:2.0:1786400921.926690:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+55:10539:x1873176850126592:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786400921.926712:0:6615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400921.926747:0:6615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e0e2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bcca expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.926850:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e0e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.926866:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.926877:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400921.926890:0:6615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1786400921.926992:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.927001:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e0e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.927008:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e0e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.927014:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1bbe00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400921.927019:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e0e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.927027:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e0e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.927040:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d6fc5599c00) 00010000:00010000:2.0:1786400921.927044:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786400921.927048:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e0e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.927066:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e0e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.928743:0:6615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e0e2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcca expref: 57 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.928763:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d6fc5599600) 00010000:00010000:2.0:1786400921.928767:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786400921.928773:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e0e2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcca expref: 57 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.928792:0:6615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fee1bba00, rc 0) 00000100:00100000:2.0:1786400921.928883:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+56:10539:x1873176850126592:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 2194us (2916us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1786400921.928894:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 114 00000100:00100000:3.0:1786400921.933328:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400921.933465:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850126720 00000100:00100000:1.0:1786400921.933480:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850126720 00000100:00100000:1.0:1786400921.934944:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 115 00000100:00100000:1.0:1786400921.934973:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+56:10539:x1873176850126720:12345-192.168.204.8@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1786400921.935070:0:5788:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1786400921.935288:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+56:10539:x1873176850126720:12345-192.168.204.8@tcp:53:lhsmtool_posix.0 Request processed in 327us (1973us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400921.935297:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 115 00000100:00100000:3.0:1786400921.940231:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400921.940365:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850126976 00000100:00100000:1.0:1786400921.940380:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850126976 00000100:00100000:1.0:1786400921.940472:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 116 00000100:00100000:1.0:1786400921.940485:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+56:10539:x1873176850126976:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786400921.940526:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400921.940530:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1786400921.940565:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e087 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcae expref: 56 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.940590:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d6fd022e000) 00010000:00010000:1.0:1786400921.940595:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786400921.940610:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e0f7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bcd1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786400921.941684:0:5790:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1786400921.941961:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e0fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.941979:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e0fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.942014:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e0fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.942116:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e0f7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcd1 expref: 58 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.942137:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e0fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcd1 expref: 57 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.942146:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d6fe06cb900) 00010000:00010000:1.0:1786400921.942150:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786400921.942153:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138ee00, rc 0) 00000100:00100000:1.0:1786400921.942247:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+57:10539:x1873176850126976:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 1763us (2028us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1786400921.942256:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 116 00000100:00100000:2.0:1786400921.946750:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400921.946909:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850127232 00000100:00100000:0.0:1786400921.946921:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850127232 00000100:00100000:0.0:1786400921.947000:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 117 00000100:00100000:0.0:1786400921.947011:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+57:10539:x1873176850127232:12345-192.168.204.8@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1786400921.947322:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400921.947373:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e0fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcd1 expref: 57 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.947400:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d6fe06cb900) 00010000:00010000:0.0:1786400921.947416:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786400921.947449:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e10c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.947477:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e10c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.947647:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e10c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.950193:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e113 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x50fa7f0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.950219:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e113 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x50fa7f0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.950233:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e113 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x50fa7f0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.950322:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e10c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.950330:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e10c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.950337:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e10c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.950343:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aaa00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400921.950347:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e10c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.950354:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e10c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.950367:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d6fd022e000) 00010000:00010000:0.0:1786400921.950370:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400921.950375:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e10c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.950395:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e10c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.950412:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e113 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x50fa7f0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.950418:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e113 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x50fa7f0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.950425:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e113 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x50fa7f0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.950430:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5ab600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400921.950433:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e113 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x50fa7f0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.950438:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e113 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x50fa7f0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.950447:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x50fa7f0d (ffff9d6fc90cdb00) 00010000:00010000:0.0:1786400921.950449:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400921.950452:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e113 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x50fa7f0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400921.950468:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e113 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x50fa7f0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400921.951798:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+56:10539:x1873176850127232:12345-192.168.204.8@tcp:36:lhsmtool_posix.0 Request processed in 4781us (5053us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786400921.951811:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 117 00000100:00100000:3.0:1786400921.955967:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400921.956232:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850127360 00000100:00100000:2.0:1786400921.956242:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850127360 00000100:00100000:2.0:1786400921.956294:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 118 00000100:00100000:2.0:1786400921.956305:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+56:10539:x1873176850127360:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786400921.956326:0:6615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400921.956349:0:6615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e11a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bcd8 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.956391:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e121 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.956420:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.956432:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.956536:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e11a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcd8 expref: 58 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.956553:0:6615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e121 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcd8 expref: 57 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.956562:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d6fd022e100) 00010000:00010000:2.0:1786400921.956565:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786400921.956568:0:6615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fee1bbe00, rc 0) 00000100:00100000:2.0:1786400921.956644:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+57:10539:x1873176850127360:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 340us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400921.956651:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 118 00000100:00100000:3.0:1786400921.965582:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400921.965758:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850127616 00000100:00100000:1.0:1786400921.965774:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850127616 00000100:00100000:1.0:1786400921.965856:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 119 00000100:00100000:1.0:1786400921.965868:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+57:10539:x1873176850127616:12345-192.168.204.8@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1786400921.965983:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e128 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.966001:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e128 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400921.966015:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e128 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786400921.966339:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:1.0:1786400921.966350:0:5788:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 374367262825ns, next at 375367259812ns, rc = 0 00000004:00010000:1.0:1786400921.970011:0:5788:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c184a1af reply state 00000000c74a179c transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e128 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400921.970031:0:5788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786400921.970212:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+59:10539:x1873176850127616:12345-192.168.204.8@tcp:36:lhsmtool_posix.0 Request processed in 4343us (4650us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1786400921.970222:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 119 00010000:00010000:2.0:1786400921.977340:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e128 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.977366:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e128 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.977375:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e128 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.977382:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138fa00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400921.977388:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e128 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.977417:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e128 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.977440:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d6fd022e100) 00010000:00010000:2.0:1786400921.977444:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786400921.977450:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e128 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.977468:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e128 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400921.978736:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400921.979704:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850127744 00000100:00100000:2.0:1786400921.979723:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850127744 00000100:00100000:2.0:1786400921.979859:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 120 00000100:00100000:2.0:1786400921.979874:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+58:10539:x1873176850127744:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786400921.979911:0:6615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400921.980009:0:6615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e12f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bcdf expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.980123:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e12f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcdf expref: 59 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.980142:0:6615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e12f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcdf expref: 59 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400921.980167:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d6fd022e100) 00010000:00010000:2.0:1786400921.980170:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786400921.980275:0:6615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fee1bba00, rc 0) 00000100:00100000:2.0:1786400921.980378:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+59:10539:x1873176850127744:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 507us (1653us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400921.980387:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 120 00000100:00100000:0.0:1786400921.984807:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400921.984894:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850127872 00000100:00100000:3.0:1786400921.984907:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850127872 00000100:00100000:3.0:1786400921.984995:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 38 00000100:00100000:3.0:1786400921.985008:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+8:2364:x1873176850127872:12345-192.168.204.8@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1786400921.985448:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+9:2364:x1873176850127872:12345-192.168.204.8@tcp:2:lhsmtool_posix.0 Request processed in 442us (654us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1786400921.985489:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 38 00000100:00100000:3.0:1786400921.996546:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400921.996660:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850128128 00000100:00100000:2.0:1786400921.996679:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850128128 00000100:00100000:2.0:1786400921.996897:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 30 00000100:00100000:2.0:1786400921.996917:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+59:10539:x1873176850128128:12345-192.168.204.8@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1786400921.997240:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+60:10539:x1873176850128128:12345-192.168.204.8@tcp:35:lhsmtool_posix.0 Request processed in 331us (703us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1786400921.997248:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 30 00000100:00100000:0.0:1786400922.000516:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400922.000635:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850128384 00000100:00100000:3.0:1786400922.000645:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850128384 00000100:00100000:3.0:1786400922.001155:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 121 00000100:00100000:3.0:1786400922.001167:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+60:10539:x1873176850128384:12345-192.168.204.8@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1786400922.001487:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+60:10539:x1873176850128384:12345-192.168.204.8@tcp:57:lhsmtool_posix.0 Request processed in 322us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400922.001496:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 121 00000100:00100000:0.0:1786400922.004389:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400922.004753:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850128512 00000100:00100000:1.0:1786400922.004763:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850128512 00000100:00100000:1.0:1786400922.004828:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 122 00000100:00100000:1.0:1786400922.004844:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+60:10539:x1873176850128512:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786400922.004864:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400922.004885:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e136 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bce6 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.004958:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e13d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.005064:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e13d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.005078:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e13d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400922.005404:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786400922.005428:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e13d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.005485:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e136 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bce6 expref: 62 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.005506:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e13d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bce6 expref: 61 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.005516:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d6fd022e100) 00010000:00010000:1.0:1786400922.005519:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786400922.005524:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138fa00, rc 0) 00000100:00100000:1.0:1786400922.006358:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+61:10539:x1873176850128512:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 1511us (1973us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400922.006368:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 122 00000100:00100000:0.0:1786400922.010214:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400922.010408:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850128640 00000100:00100000:2.0:1786400922.010419:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850128640 00000100:00080000:3.0:1786400922.010498:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786400922.010689:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 39 00000100:00100000:2.0:1786400922.010700:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+9:2362:x1873176850128640:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786400922.010719:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400922.010741:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093b52c68/0x5ccaaf4f3cb1e144 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bced expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786400922.010768:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a7a5098, blocks: 0x1 00010000:00010000:2.0:1786400922.010786:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=374s v=(0 0) 00010000:00010000:2.0:1786400922.010790:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400922.010799:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093b52c68/0x5ccaaf4f3cb1e144 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bced expref: 10 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400922.010817:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000093b52c68/0x5ccaaf4f3cb1e144 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bced expref: 10 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400922.010847:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fee1bbc00, rc 0) 00000100:00100000:2.0:1786400922.010915:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+10:2362:x1873176850128640:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 216us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400922.010921:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 39 00000100:00100000:0.0:1786400922.014569:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400922.014779:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850128896 00000100:00100000:1.0:1786400922.014789:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850128896 00000100:00100000:1.0:1786400922.014849:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 123 00000100:00100000:1.0:1786400922.014860:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+61:10539:x1873176850128896:12345-192.168.204.8@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1786400922.014988:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+61:10539:x1873176850128896:12345-192.168.204.8@tcp:57:lhsmtool_posix.0 Request processed in 129us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400922.014997:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 123 00000100:00100000:0.0:1786400922.018769:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400922.019216:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850129024 00000100:00100000:3.0:1786400922.019233:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850129024 00000100:00100000:3.0:1786400922.019618:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 40 00000100:00100000:3.0:1786400922.019631:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+10:10539:x1873176850129024:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786400922.019676:0:6593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400922.019703:0:6593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d99ae31/0x5ccaaf4f3cb1e14b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bcf4 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400922.019750:0:6593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000093b52c68/0x5ccaaf4f3cb1e144 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bced expref: 11 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400922.019760:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400922.019765:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400922.019771:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d99ae31/0x5ccaaf4f3cb1e14b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcf4 expref: 11 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400922.019862:0:6593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000093b52c68/0x5ccaaf4f3cb1e144 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bced expref: 11 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400922.019879:0:6593:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000093b52c68/0x5ccaaf4f3cb1e144 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bced expref: 11 pid: 6590 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400922.019898:0:6593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6593:1873176872156928:192.168.204.8@tcp:104: 00000100:00100000:3.0:1786400922.020233:0:6593:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffccb7540 going to sleep for 11 seconds 00000100:00100000:0.0:1786400922.025967:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400922.026271:0:8369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850129152 00000100:00100000:1.0:1786400922.026285:0:8369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850129152 00010000:00010000:1.0:1786400922.026336:0:8369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000093b52c68/0x5ccaaf4f3cb1e144 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bced expref: 12 pid: 6590 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400922.026392:0:8369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 55 00000100:00100000:1.0:1786400922.026402:0:8369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+12:2364:x1873176850129152:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400922.026435:0:8369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1786400922.026437:0:6593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6593:1873176872156928:192.168.204.8@tcp:104: 00010000:00010000:1.0:1786400922.026474:0:8369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000093b52c68/0x5ccaaf4f3cb1e144 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bced expref: 12 pid: 6590 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400922.026502:0:6593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002d99ae31/0x5ccaaf4f3cb1e14b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcf4 expref: 12 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.026508:0:8369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000093b52c68/0x5ccaaf4f3cb1e144 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bced expref: 12 pid: 6590 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.026912:0:8369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093b52c68/0x5ccaaf4f3cb1e144 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bced expref: 12 pid: 6590 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400922.026919:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400922.026941:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400922.026954:0:6593:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002d99ae31/0x5ccaaf4f3cb1e14b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcf4 expref: 11 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400922.026967:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d99ae31/0x5ccaaf4f3cb1e14b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcf4 expref: 11 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.026985:0:8369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786400922.027019:0:6593:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002d99ae31/0x5ccaaf4f3cb1e14b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcf4 expref: 11 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400922.027039:0:6593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6593:1873176872157056:192.168.204.8@tcp:105: 00000100:00100000:1.0:1786400922.027062:0:8369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+11:2364:x1873176850129152:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 658us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400922.027074:0:8369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 55 00000100:00100000:3.0:1786400922.028485:0:6593:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffccb7540 going to sleep for 11 seconds 00000100:00100000:3.0:1786400922.032536:0:6593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc99c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6593:1873176872157056:192.168.204.8@tcp:105: 00010000:00010000:3.0:1786400922.032580:0:6593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca091a00, rc 0) 00000100:00100000:3.0:1786400922.032674:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+10:10539:x1873176850129024:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 13045us (13912us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400922.032686:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 40 00000100:00100000:0.0:1786400922.037257:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400922.037747:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850129280 00000100:00100000:3.0:1786400922.037762:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850129280 00002000:00100000:3.0:1786400922.037860:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9d6ffdbc1180 x1873176850129280/t0(0) o4->096c63d9-38b8-441b-8c71-343db25fe88a@192.168.204.8@tcp:718/0 lens 504/0 e 0 to 0 dl 1786400933 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786400922.037873:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ffdbc1180 with x1873176850129280 ext(0->12) 00002000:00010000:3.0:1786400922.037881:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d6ffdbc1180 00000100:00100000:3.0:1786400922.037931:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 3 00000100:00100000:3.0:1786400922.037943:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:096c63d9-38b8-441b-8c71-343db25fe88a+10:2365:x1873176850129280:12345-192.168.204.8@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1786400922.041440:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:096c63d9-38b8-441b-8c71-343db25fe88a+12:2365:x1873176850129280:12345-192.168.204.8@tcp:4:lhsmtool_posix.0 Request processed in 3483us (4179us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1786400922.041471:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 3 00002000:00100000:2.0:1786400922.043049:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9d6ffdbc1180 x1873176850129280/t4294967309(0) o4->096c63d9-38b8-441b-8c71-343db25fe88a@192.168.204.8@tcp:718/0 lens 504/448 e 0 to 0 dl 1786400933 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786400922.043071:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ffdbc1180 with x1873176850129280 ext(0->12) 00002000:00010000:2.0:1786400922.043080:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d6ffdbc1180 00000100:00100000:0.0:1786400922.047513:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400922.047604:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850129408 00000100:00100000:2.0:1786400922.047615:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850129408 00000100:00100000:2.0:1786400922.047749:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 124 00000100:00100000:2.0:1786400922.047762:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+61:10539:x1873176850129408:12345-192.168.204.8@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1786400922.087689:0:5810:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967392 is committed 00000004:00080000:0.0:1786400922.087709:0:5810:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:3.0:1786400922.087926:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872157184:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1786400922.088001:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400922.088060:0:11770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872157184 00000100:00100000:3.0:1786400922.088068:0:11770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872157184 00000100:00100000:3.0:1786400922.088129:0:11770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1786400922.088138:0:11770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872157184:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1786400922.088161:0:11770:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:3.0:1786400922.088209:0:11770:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a7a5097, atime: 0x6a7a5097, ctime: 0x6a7a5097, blocks: 0xb 00010000:00010000:3.0:1786400922.088217:0:11770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003de1132e/0x5ccaaf4f3cb1e152 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400922.088231:0:11770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=374s v=(0 0) 00010000:00010000:3.0:1786400922.088235:0:11770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400922.088241:0:11770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003de1132e/0x5ccaaf4f3cb1e152 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400922.088258:0:11770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003de1132e/0x5ccaaf4f3cb1e152 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400922.088268:0:11770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003de1132e/0x5ccaaf4f3cb1e152 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400922.088275:0:11770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003de1132e/0x5ccaaf4f3cb1e152 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400922.088293:0:11770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786400922.088893:0:11770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1873176872157184:12345-0@lo:6:osp-syn-0-0.0 Request processed in 754us (889us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1786400922.088902:0:11770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:3.0:1786400922.088934:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786400922.088941:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003de1132e/0x5ccaaf4f3cb1e152 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400922.088950:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca091c00 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:3.0:1786400922.088955:0:5776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003de1132e/0x5ccaaf4f3cb1e152 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400922.088965:0:5776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003de1132e/0x5ccaaf4f3cb1e152 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400922.088984:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003de1132e/0x5ccaaf4f3cb1e152 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400922.088991:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003de1132e/0x5ccaaf4f3cb1e152 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400922.089012:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400922.089014:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400922.089016:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400922.089046:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1786400922.089052:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:3.0:1786400922.089071:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d6fc6082d80, transno 4294967301 00000004:00080000:3.0:1786400922.089080:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:3.0:1786400922.089135:0:3309:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9d6ffdc99c00 x1873176872157184/t4294967304(4294967304) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1786400938 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1786400922.089156:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d6ffdc99c00/2, rc 0, transno 4294967304 00000100:00100000:3.0:1786400922.089161:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872157184:0@lo:6:osp-syn-0-0.0 00000020:00080000:0.0:1786400922.089793:0:5810:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d6fc9c7e180 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1786400922.089800:0:5810:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d6fc923ac00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d6fc9c7ec00 00000020:00080000:0.0:1786400922.089804:0:5810:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d6fc923a900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d6fca210000 00000001:00080000:0.0:1786400922.089845:0:5810:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:0.0:1786400922.089849:0:5810:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:0.0:1786400922.089876:0:5810:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1786400922.089890:0:5810:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1786400922.089902:0:5810:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d6fc56af900 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1786400922.089904:0:5810:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d6ff5f86e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d6fc56afa80 00000020:00080000:0.0:1786400922.089907:0:5810:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d6ff5f86b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d6ffd25d400 00000020:00080000:0.0:1786400922.089941:0:5822:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1786400922.090063:0:5822:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1786400922.090314:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+15:10539:x1873176850129408:12345-192.168.204.8@tcp:44:lhsmtool_posix.0 Request processed in 42550us (42812us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400922.090325:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 124 00000100:00100000:2.0:1786400922.092116:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872157312:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1786400922.092327:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400922.092737:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872157312 00000100:00100000:0.0:1786400922.092746:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872157312 00000100:00100000:0.0:1786400922.092804:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1786400922.092813:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872157312:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1786400922.092843:0:6592:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1786400922.092869:0:6592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee380ae2/0x5ccaaf4f3cb1e159 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.092890:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007f3657a3/0x5ccaaf4f3cb1df14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc53 expref: 11 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.092898:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1786400922.092901:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1786400922.092905:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee380ae2/0x5ccaaf4f3cb1e159 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.092931:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007f3657a3/0x5ccaaf4f3cb1df14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc53 expref: 11 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.092945:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007f3657a3/0x5ccaaf4f3cb1df14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc53 expref: 11 pid: 6590 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400922.092956:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdbc0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6592:1873176872157440:192.168.204.8@tcp:104: 00000100:00100000:0.0:1786400922.093012:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec5984600 going to sleep for 11 seconds 00000100:00100000:2.0:1786400922.094964:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786400922.094984:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872157568:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1786400922.095047:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400922.097867:0:11770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872157568 00000100:00100000:1.0:1786400922.097882:0:11770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872157568 00000100:00100000:1.0:1786400922.097944:0:11770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1786400922.097955:0:11770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1873176872157568:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1786400922.098169:0:11770:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1786400922.099164:0:11770:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1786400920 00002000:00010000:1.0:1786400922.099217:0:11770:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786400922.099220:0:11770:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1786400920 -> 1786400920 00002000:00010000:1.0:1786400922.099222:0:11770:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1786400922.099319:0:11770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1873176872157568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1363us (4269us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1786400922.099330:0:11770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1786400922.099664:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1786400922.099671:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:1.0:1786400922.099707:0:3306:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9d6ffdc9b800 x1873176872157568/t4294967310(4294967310) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1786400938 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1786400922.099720:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d6ffdc9b800/2, rc 0, transno 4294967310 00000100:00100000:1.0:1786400922.099725:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872157568:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1786400922.101292:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400922.101485:0:11770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850129536 00000100:00100000:1.0:1786400922.101494:0:11770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850129536 00000100:00100000:1.0:1786400922.101563:0:11770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 44 00000100:00100000:1.0:1786400922.101573:0:11770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:096c63d9-38b8-441b-8c71-343db25fe88a+12:2362:x1873176850129536:12345-192.168.204.8@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1786400922.101892:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdbc0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6592:1873176872157440:192.168.204.8@tcp:104: 00010000:00010000:3.0:1786400922.101920:0:6592:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ee380ae2/0x5ccaaf4f3cb1e159 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1786400922.102509:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786400922.112993:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400922.114026:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850129664 00000100:00100000:1.0:1786400922.114040:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850129664 00010000:00010000:1.0:1786400922.114108:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007f3657a3/0x5ccaaf4f3cb1df14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc53 expref: 13 pid: 6590 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400922.114147:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 56 00000100:00100000:1.0:1786400922.114156:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc98e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096c63d9-38b8-441b-8c71-343db25fe88a+13:2364:x1873176850129664:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400922.114169:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400922.114186:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007f3657a3/0x5ccaaf4f3cb1df14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc53 expref: 13 pid: 6590 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.114199:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007f3657a3/0x5ccaaf4f3cb1df14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc53 expref: 13 pid: 6590 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.114221:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f3657a3/0x5ccaaf4f3cb1df14 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc53 expref: 13 pid: 6590 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.114249:0:5773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786400922.114253:0:5773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786400922.114259:0:5773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee380ae2/0x5ccaaf4f3cb1e159 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.114268:0:5773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee380ae2/0x5ccaaf4f3cb1e159 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.114298:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400922.114545:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc98e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096c63d9-38b8-441b-8c71-343db25fe88a+12:2364:x1873176850129664:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 389us (1561us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400922.114553:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 56 00010000:00010000:0.0:1786400922.114669:0:6592:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ee380ae2/0x5ccaaf4f3cb1e159 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.114679:0:6592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee380ae2/0x5ccaaf4f3cb1e159 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.114701:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee380ae2/0x5ccaaf4f3cb1e159 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.114708:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee380ae2/0x5ccaaf4f3cb1e159 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.114727:0:6592:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1786400922.117164:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1873176872157312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 22526us (23012us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1786400922.117770:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:0.0:1786400922.117812:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786400922.117820:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee380ae2/0x5ccaaf4f3cb1e159 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.117833:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5ab200 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:0.0:1786400922.117838:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee380ae2/0x5ccaaf4f3cb1e159 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.117848:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee380ae2/0x5ccaaf4f3cb1e159 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.117870:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee380ae2/0x5ccaaf4f3cb1e159 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.117876:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee380ae2/0x5ccaaf4f3cb1e159 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.117907:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400922.117909:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400922.117911:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1786400922.118067:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d6ffdc99500/2, rc 0, transno 4294967311 00000100:00100000:0.0:1786400922.118075:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872157312:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1786400922.146982:0:7501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1786400922.147002:0:7501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:0.0:1786400922.147211:0:11770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:096c63d9-38b8-441b-8c71-343db25fe88a+6:2362:x1873176850129536:12345-192.168.204.8@tcp:16:lhsmtool_posix.0 Request processed in 45633us (45919us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400922.147224:0:11770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 44 00000100:00100000:3.0:1786400922.151298:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400922.151412:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850129920 00000100:00100000:1.0:1786400922.151422:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850129920 00000100:00100000:1.0:1786400922.151599:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 125 00000100:00100000:1.0:1786400922.151611:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+15:10539:x1873176850129920:12345-192.168.204.8@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1786400922.151668:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400922.151703:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e13d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bce6 expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.151725:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d6fd022e100) 00010000:00010000:1.0:1786400922.151730:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786400922.151761:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e160 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.151774:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e160 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.151797:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e160 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786400922.152046:0:5788:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a9f7eebe reply state 0000000066bbdebb transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e160 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400922.152056:0:5788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786400922.152225:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+16:10539:x1873176850129920:12345-192.168.204.8@tcp:36:lhsmtool_posix.0 Request processed in 615us (936us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1786400922.152233:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 125 00000100:00100000:2.0:1786400922.157611:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:1.0:1786400922.157718:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e160 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.157733:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e160 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.157741:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e160 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.157747:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138e600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400922.157751:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e160 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.157759:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e160 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.157776:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d6fd022e100) 00010000:00010000:1.0:1786400922.157779:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400922.157783:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e160 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.157808:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e160 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400922.158037:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850130048 00000100:00100000:0.0:1786400922.158048:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850130048 00000100:00100000:1.0:1786400922.158501:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 45 00000100:00100000:1.0:1786400922.158513:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+6:2365:x1873176850130048:12345-192.168.204.8@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1786400922.158736:0:6590:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1786400922.158739:0:6590:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1786400920 -> 1786400920 00002000:00010000:1.0:1786400922.158741:0:6590:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1786400919 00002000:00010000:1.0:1786400922.158743:0:6590:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1786400920 -> 1786400920 00002000:00010000:1.0:1786400922.158745:0:6590:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1786400922.158821:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+7:2365:x1873176850130048:12345-192.168.204.8@tcp:2:lhsmtool_posix.0 Request processed in 309us (1220us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1786400922.158829:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 45 00000100:00100000:0.0:1786400922.161363:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400922.161472:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850130304 00000100:00100000:1.0:1786400922.161483:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850130304 00000100:00100000:1.0:1786400922.161705:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 126 00000100:00100000:1.0:1786400922.161717:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+15:10539:x1873176850130304:12345-192.168.204.8@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1786400922.161791:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e167 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.161809:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e121 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcd8 expref: 15 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.161819:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e167 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.161873:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e121 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcd8 expref: 15 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.161887:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e121 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcd8 expref: 15 pid: 6615 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400922.161902:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee1bc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5790:1873176872157696:192.168.204.8@tcp:104: 00000100:00100000:1.0:1786400922.162001:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc4e18480 going to sleep for 11 seconds 00000100:00100000:0.0:1786400922.167894:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400922.168395:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850130432 00000100:00100000:2.0:1786400922.168406:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850130432 00010000:00010000:2.0:1786400922.168464:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e121 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcd8 expref: 16 pid: 6615 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400922.168516:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 57 00000100:00100000:2.0:1786400922.168526:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096c63d9-38b8-441b-8c71-343db25fe88a+16:2365:x1873176850130432:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786400922.168542:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400922.168549:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e121 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcd8 expref: 16 pid: 6615 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400922.168563:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e121 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcd8 expref: 16 pid: 6615 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400922.168588:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d6fd022e100) 00010000:00010000:2.0:1786400922.168593:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e167 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400922.168603:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e167 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400922.168611:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e167 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400922.168632:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400922.168701:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096c63d9-38b8-441b-8c71-343db25fe88a+16:2365:x1873176850130432:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 176us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400922.168723:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 57 00010000:00010000:1.0:1786400922.169910:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e121 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcd8 expref: 15 pid: 6615 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400922.169932:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee1bc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5790:1873176872157696:192.168.204.8@tcp:104: 00010000:00010000:1.0:1786400922.169955:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e167 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.169964:0:5790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e167 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.169970:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e167 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.169999:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e167 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.170006:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e167 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.170014:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e167 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.170032:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138fa00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400922.170050:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e167 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.170058:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e167 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.170072:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d6fd022e100) 00010000:00010000:1.0:1786400922.170075:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1786400922.170078:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e167 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.170795:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e167 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400922.170886:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+14:10539:x1873176850130304:12345-192.168.204.8@tcp:55:lhsmtool_posix.0 Request processed in 9169us (9530us total) trans 0 rc -22/-22 00000100:00100000:1.0:1786400922.170896:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 126 00000100:00100000:0.0:1786400922.173687:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400922.173793:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850130560 00000100:00100000:3.0:1786400922.173804:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850130560 00000100:00100000:3.0:1786400922.173904:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 46 00000100:00100000:3.0:1786400922.173918:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+7:2364:x1873176850130560:12345-192.168.204.8@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1786400922.173973:0:6592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003de1132e/0x5ccaaf4f3cb1e16e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400922.173998:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002d99ae31/0x5ccaaf4f3cb1e14b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcf4 expref: 7 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400922.174009:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400922.174013:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786400922.174018:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003de1132e/0x5ccaaf4f3cb1e16e lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400922.174070:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002d99ae31/0x5ccaaf4f3cb1e14b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcf4 expref: 7 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400922.174149:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002d99ae31/0x5ccaaf4f3cb1e14b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcf4 expref: 7 pid: 6593 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400922.174183:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc9a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6592:1873176872157824:192.168.204.8@tcp:104: 00000100:00100000:3.0:1786400922.174274:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc56af540 going to sleep for 11 seconds 00000100:00100000:1.0:1786400922.177624:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc9a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6592:1873176872157824:192.168.204.8@tcp:104: 00010000:00010000:1.0:1786400922.177660:0:6592:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003de1132e/0x5ccaaf4f3cb1e16e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400922.179004:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400922.179597:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850130688 00000100:00100000:1.0:1786400922.179608:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850130688 00010000:00010000:1.0:1786400922.179650:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002d99ae31/0x5ccaaf4f3cb1e14b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcf4 expref: 8 pid: 6593 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400922.179683:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 58 00000100:00100000:1.0:1786400922.179710:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096c63d9-38b8-441b-8c71-343db25fe88a+8:2364:x1873176850130688:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400922.179726:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400922.179751:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002d99ae31/0x5ccaaf4f3cb1e14b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcf4 expref: 8 pid: 6593 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.179766:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002d99ae31/0x5ccaaf4f3cb1e14b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcf4 expref: 8 pid: 6593 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.179791:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d99ae31/0x5ccaaf4f3cb1e14b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcf4 expref: 8 pid: 6593 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.179810:0:5773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786400922.179815:0:5773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786400922.179821:0:5773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003de1132e/0x5ccaaf4f3cb1e16e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.179831:0:5773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003de1132e/0x5ccaaf4f3cb1e16e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.179862:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400922.179919:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096c63d9-38b8-441b-8c71-343db25fe88a+7:2364:x1873176850130688:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 210us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400922.179927:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 58 00010000:00010000:1.0:1786400922.180043:0:6592:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003de1132e/0x5ccaaf4f3cb1e16e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.180053:0:6592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003de1132e/0x5ccaaf4f3cb1e16e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.180110:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003de1132e/0x5ccaaf4f3cb1e16e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.180119:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003de1132e/0x5ccaaf4f3cb1e16e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.180127:0:6592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003de1132e/0x5ccaaf4f3cb1e16e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.180134:0:6592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca091c00 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:1.0:1786400922.180139:0:6592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003de1132e/0x5ccaaf4f3cb1e16e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.180148:0:6592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003de1132e/0x5ccaaf4f3cb1e16e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.180160:0:6592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003de1132e/0x5ccaaf4f3cb1e16e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.180167:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003de1132e/0x5ccaaf4f3cb1e16e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400922.180226:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+6:2364:x1873176850130560:12345-192.168.204.8@tcp:1:lhsmtool_posix.0 Request processed in 6311us (6550us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400922.180234:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 46 00000100:00100000:3.0:1786400922.185081:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400922.185600:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850130944 00000100:00100000:0.0:1786400922.185611:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850130944 00000100:00100000:0.0:1786400922.185703:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 127 00000100:00100000:0.0:1786400922.185714:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+14:10539:x1873176850130944:12345-192.168.204.8@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1786400922.185794:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e175 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.185813:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e175 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.185826:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e175 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.186053:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e17c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.186079:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e12f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcdf expref: 15 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.186107:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e17c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.186145:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e12f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcdf expref: 15 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.186160:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e12f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcdf expref: 15 pid: 6615 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400922.186186:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdbc0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5789:1873176872157952:192.168.204.8@tcp:104: 00000100:00100000:0.0:1786400922.186280:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec5984d80 going to sleep for 11 seconds 00000100:00100000:1.0:1786400922.192976:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400922.193134:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850131072 00000100:00100000:2.0:1786400922.193146:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850131072 00010000:00010000:2.0:1786400922.193197:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e12f lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcdf expref: 16 pid: 6615 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400922.193241:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 59 00000100:00100000:2.0:1786400922.193251:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096c63d9-38b8-441b-8c71-343db25fe88a+16:2365:x1873176850131072:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786400922.193269:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400922.193276:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e12f lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcdf expref: 16 pid: 6615 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400922.193289:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e12f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcdf expref: 16 pid: 6615 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400922.193313:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d6fd022e100) 00010000:00010000:2.0:1786400922.193319:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e17c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400922.193330:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e17c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400922.193338:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e17c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400922.193715:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400922.193779:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096c63d9-38b8-441b-8c71-343db25fe88a+16:2365:x1873176850131072:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 528us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400922.193805:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 59 00010000:00010000:0.0:1786400922.194871:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e12f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcdf expref: 15 pid: 6615 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400922.194894:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdbc0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5789:1873176872157952:192.168.204.8@tcp:104: 00010000:00010000:0.0:1786400922.194919:0:5789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e17c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.194929:0:5789:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e17c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.194935:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e17c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786400922.195823:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1786400922.196001:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1786400922.196042:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1786400922.196160:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdbc0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5789:1873176872158080:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1786400922.196888:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400922.197063:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec5984f00 going to sleep for 11 seconds 00000100:00100000:1.0:1786400922.197150:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872158080 00000100:00100000:1.0:1786400922.197158:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872158080 00000100:00100000:1.0:1786400922.197313:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1786400922.197323:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd61c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5789:x1873176872158080:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1786400922.197425:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd61c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5789:x1873176872158080:12345-0@lo:1000:mdt00_001.0 Request processed in 102us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400922.197432:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1786400922.197687:0:5789:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1786400922.197694:0:5789:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d6ffdc9b800, transno 4294967310 00000100:00100000:0.0:1786400922.197720:0:5789:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9d6ffdc99500 x1873176872157312/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1786400938 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400922.197731:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdbc0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5789:1873176872158080:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1786400922.198264:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1786400922.198342:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd61f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5789:1873176872158208:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1786400922.198380:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400922.199003:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec5984d80 going to sleep for 11 seconds 00000100:00100000:3.0:1786400922.199035:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872158208 00000100:00100000:3.0:1786400922.199041:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872158208 00000100:00100000:3.0:1786400922.199082:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1786400922.199424:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd61e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5789:x1873176872158208:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1786400922.199644:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd61e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5789:x1873176872158208:12345-0@lo:1000:mdt00_001.0 Request processed in 224us (1262us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1786400922.199652:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1786400922.199738:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd61f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5789:1873176872158208:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1786400922.199776:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e17c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.199787:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e17c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.199795:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e17c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.199801:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5ab600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400922.199805:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e17c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.199814:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e17c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.199841:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d6fd022e100) 00010000:00010000:0.0:1786400922.199844:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786400922.199849:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e17c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.199855:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e17c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.199887:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba000/0x5ccaaf4f3cb1e0bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.199894:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba000/0x5ccaaf4f3cb1e0bf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.199900:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba000/0x5ccaaf4f3cb1e0bf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.199905:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1ba000 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400922.199908:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba000/0x5ccaaf4f3cb1e0bf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.199914:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba000/0x5ccaaf4f3cb1e0bf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.199921:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d6fc5599c00) 00010000:00010000:0.0:1786400922.199924:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786400922.199931:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1e0c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcc3 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.199942:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1e0c6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcc3 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.199956:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1e0c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcc3 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.199984:0:5789:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1e0c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcc3 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400922.199997:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd61d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5789:1873176872158336:192.168.204.8@tcp:105: 00000100:00100000:0.0:1786400922.200067:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec5984d80 going to sleep for 11 seconds 00000100:00100000:1.0:1786400922.203322:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400922.203526:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd61d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5789:1873176872158336:192.168.204.8@tcp:105: 00010000:00010000:0.0:1786400922.203552:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba000/0x5ccaaf4f3cb1e0bf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.203563:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba000/0x5ccaaf4f3cb1e0bf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.203600:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e183 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.203613:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e183 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.203624:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e183 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.203634:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e183 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.203641:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e183 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.203662:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e183 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.203668:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aa600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400922.203672:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e183 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.203679:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e183 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.203689:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d6fc5599c00) 00010000:00010000:0.0:1786400922.203691:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400922.203695:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e183 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.203701:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e183 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.203710:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e175 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.203716:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e175 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.203722:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e175 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.203726:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aaa00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400922.203729:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e175 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.203742:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e175 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.203749:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d6fc5599c00) 00010000:00010000:0.0:1786400922.203751:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786400922.203754:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e175 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400922.203759:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e175 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400922.203953:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+18:10539:x1873176850130944:12345-192.168.204.8@tcp:57:lhsmtool_posix.0 Request processed in 18241us (18882us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1786400922.203963:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 127 00000020:00080000:0.0:1786400922.203969:0:5789:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1786400922.205135:0:11546:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786400922.205142:0:11546:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786400922.206573:0:11546:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1786400922.206589:0:11546:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786400922.207235:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850131200 00000100:00100000:3.0:1786400922.207247:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850131200 00000100:00100000:3.0:1786400922.207313:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 31 00000100:00100000:3.0:1786400922.207325:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+18:10538:x1873176850131200:12345-192.168.204.8@tcp:49:lfs.0 00000100:00100000:3.0:1786400922.207856:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+18:10538:x1873176850131200:12345-192.168.204.8@tcp:49:lfs.0 Request processed in 533us (4542us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400922.207864:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 31 00000100:00100000:0.0:1786400922.208968:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400922.209261:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850131456 00000100:00100000:2.0:1786400922.209269:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850131456 00000100:00100000:2.0:1786400922.209306:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 32 00000100:00100000:2.0:1786400922.209315:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6d7c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+18:10539:x1873176850131456:12345-192.168.204.8@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1786400922.211521:0:5791:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1786400922.211708:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1786400922.211771:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e18a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400922.211787:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e18a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400922.211798:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e18a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400922.211806:0:5791:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e18a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400922.211811:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e18a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400922.211817:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e18a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400922.212006:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1786400922.212155:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6d7c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+20:10539:x1873176850131456:12345-192.168.204.8@tcp:35:lhsmtool_posix.0 Request processed in 2835us (3186us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1786400922.212165:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 32 00000020:00080000:2.0:1786400922.212181:0:5791:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1786400922.213752:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786400922.213764:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e18a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400922.213789:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1ba600 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:3.0:1786400922.213794:0:5776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e18a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400922.213803:0:5776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e18a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400922.213819:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9d6fd022e900) 00010000:00010000:3.0:1786400922.213822:0:5776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786400922.213827:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e18a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400922.213833:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e18a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400922.213855:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400922.213857:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400922.213858:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400922.215559:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400922.215788:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850131712 00000100:00100000:2.0:1786400922.215800:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850131712 00000100:00100000:2.0:1786400922.216272:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 128 00000100:00100000:2.0:1786400922.216284:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd61d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+20:10538:x1873176850131712:12345-192.168.204.8@tcp:58:lfs.0 00000040:00080000:2.0:1786400922.216835:0:6615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1786400922.216967:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd61d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+20:10538:x1873176850131712:12345-192.168.204.8@tcp:58:lfs.0 Request processed in 684us (1417us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400922.216976:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 128 00000100:00100000:0.0:1786400922.249487:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400922.249689:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850131840 00000100:00100000:1.0:1786400922.249700:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850131840 00000100:00100000:1.0:1786400922.249766:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 129 00000100:00100000:1.0:1786400922.249777:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd61ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+20:10541:x1873176850131840:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:1.0:1786400922.249804:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400922.249825:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e191 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bcfb expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.249891:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e198 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.249909:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e198 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.249922:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e198 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.249939:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e19f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.249948:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e19f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.249971:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e19f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.250783:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1e1a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.250799:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e0b1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcbc expref: 21 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.250809:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1e1a6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.250845:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e0b1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcbc expref: 21 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.250861:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e0b1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcbc expref: 21 pid: 5789 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400922.250877:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee1be680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5788:1873176872158464:192.168.204.8@tcp:104: 00000100:00100000:1.0:1786400922.251004:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc4e18480 going to sleep for 11 seconds 00000100:00100000:0.0:1786400922.254259:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400922.254735:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee1be680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5788:1873176872158464:192.168.204.8@tcp:104: 00010000:00010000:1.0:1786400922.254763:0:5788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1e1a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400922.254827:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850132096 00000100:00100000:3.0:1786400922.254834:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850132096 00000100:00100000:2.0:1786400922.255009:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 33 00000100:00100000:2.0:1786400922.255020:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+22:5577:x1873176850132096:12345-192.168.204.8@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1786400922.255286:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+23:5577:x1873176850132096:12345-192.168.204.8@tcp:35:ldlm_bl.0 Request processed in 266us (1033us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1786400922.255293:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 33 00000100:00100000:0.0:1786400922.258325:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400922.258755:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850132224 00000100:00100000:1.0:1786400922.258766:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850132224 00010000:00010000:1.0:1786400922.258811:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e0b1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcbc expref: 23 pid: 5789 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400922.260540:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 60 00000100:00100000:1.0:1786400922.260559:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4589450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096c63d9-38b8-441b-8c71-343db25fe88a+23:2364:x1873176850132224:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400922.260578:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400922.260589:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e0b1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcbc expref: 23 pid: 5789 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.260605:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e0b1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcbc expref: 23 pid: 5789 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.260629:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e0b1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcbc expref: 23 pid: 5789 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.260647:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d6fc5599c00) 00010000:00010000:1.0:1786400922.260652:0:5773:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1e1a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.260662:0:5773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1e1a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.260670:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1e1a6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400922.260710:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400922.260833:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4589450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096c63d9-38b8-441b-8c71-343db25fe88a+22:2364:x1873176850132224:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 281us (2519us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400922.260840:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 60 00010000:00010000:2.0:1786400922.260931:0:5788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1e1a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400922.260940:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1e1a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400922.260983:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1786400922.260986:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786400922.261004:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1e1a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400922.261032:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1e1a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400922.261042:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e198 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400922.261049:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e198 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400922.261056:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e198 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400922.261062:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138f400 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400922.261067:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e198 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400922.261074:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e198 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400922.261100:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d6fd022e000) 00010000:00010000:2.0:1786400922.261102:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400922.261106:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e198 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400922.261112:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e198 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400922.261124:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e19f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400922.261130:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e19f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400922.261143:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e19f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400922.261148:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138f800 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400922.261151:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e19f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400922.261157:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e19f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400922.261164:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9d6fe06cb100) 00010000:00010000:2.0:1786400922.261166:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400922.261168:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e19f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400922.261174:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e19f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400922.261206:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e191 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcfb expref: 22 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400922.261219:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1e1a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcfb expref: 21 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400922.261226:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d6fc5599c00) 00010000:00010000:2.0:1786400922.261228:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786400922.261230:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138e800, rc 0) 00000100:00100000:2.0:1786400922.261257:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd61ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+21:10541:x1873176850131840:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 11483us (11782us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400922.261272:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 129 00010000:00010000:0.0:1786400922.549618:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786400923.030591:0:11968:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786400923.030602:0:11968:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786400923.030649:0:11968:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1786400923.030655:0:11968:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1786400923.246684:0:11546:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786400923.246694:0:11546:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786400923.246732:0:11546:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1786400923.246740:0:11546:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786400923.246886:0:11546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde21880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11546:1873176872158592:192.168.204.8@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1786400923.246993:0:11546:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fe13c63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400923.251968:0:11546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde21880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11546:1873176872158592:192.168.204.8@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1786400923.252564:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400923.252713:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850132352 00000100:00100000:1.0:1786400923.252732:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850132352 00000100:00100000:1.0:1786400923.252804:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 130 00000100:00100000:1.0:1786400923.252813:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+21:10553:x1873176850132352:12345-192.168.204.8@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1786400923.252847:0:5790:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1786400923.252945:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+21:10553:x1873176850132352:12345-192.168.204.8@tcp:53:lhsmtool_posix.0 Request processed in 128us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400923.252953:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 130 00000100:00080000:3.0:1786400923.253213:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400923.258332:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400923.258449:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850132608 00000100:00100000:3.0:1786400923.258460:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850132608 00000100:00100000:3.0:1786400923.258566:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 131 00000100:00100000:3.0:1786400923.258578:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+21:10553:x1873176850132608:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786400923.258601:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400923.258687:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091000/0x5ccaaf4f3cb1e1ad lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bd02 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400923.258813:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091600/0x5ccaaf4f3cb1e1b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400923.258828:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091600/0x5ccaaf4f3cb1e1b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400923.258842:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091600/0x5ccaaf4f3cb1e1b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400923.258856:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1786400923.259003:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091000/0x5ccaaf4f3cb1e1ad lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd02 expref: 24 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400923.259021:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091600/0x5ccaaf4f3cb1e1b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd02 expref: 23 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400923.259029:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d6fc5599c00) 00010000:00010000:3.0:1786400923.259033:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786400923.259036:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca091600, rc 0) 00000100:00100000:3.0:1786400923.259135:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+23:10553:x1873176850132608:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 558us (813us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1786400923.259144:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 131 00000100:00100000:1.0:1786400923.266381:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400923.267856:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850132864 00000100:00100000:2.0:1786400923.267870:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850132864 00000100:00100000:1.0:1786400923.268176:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400923.268286:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 132 00000100:00100000:2.0:1786400923.268298:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+23:10553:x1873176850132864:12345-192.168.204.8@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1786400923.268382:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba400/0x5ccaaf4f3cb1e1c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400923.268401:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba400/0x5ccaaf4f3cb1e1c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400923.268412:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba400/0x5ccaaf4f3cb1e1c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400923.268616:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba400/0x5ccaaf4f3cb1e1c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400923.268625:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba400/0x5ccaaf4f3cb1e1c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400923.268631:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba400/0x5ccaaf4f3cb1e1c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400923.268653:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1ba400 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400923.268657:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba400/0x5ccaaf4f3cb1e1c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400923.268665:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba400/0x5ccaaf4f3cb1e1c2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400923.268678:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d6fc5599c00) 00010000:00010000:2.0:1786400923.268683:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786400923.268688:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba400/0x5ccaaf4f3cb1e1c2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400923.268694:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba400/0x5ccaaf4f3cb1e1c2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400923.268729:0:8369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850132992 00000100:00100000:3.0:1786400923.268745:0:8369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850132992 00000100:00100000:2.0:1786400923.268897:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+25:10553:x1873176850132864:12345-192.168.204.8@tcp:57:lhsmtool_posix.0 Request processed in 599us (2525us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1786400923.268907:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 132 00000100:00100000:3.0:1786400923.269232:0:8369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 9 00000100:00100000:3.0:1786400923.269245:0:8369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+24:2365:x1873176850132992:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786400923.269279:0:8369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400923.269305:0:8369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091600/0x5ccaaf4f3cb1e1b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd02 expref: 24 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400923.269468:0:8369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d6fc5599c00) 00010000:00010000:3.0:1786400923.269475:0:8369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400923.269660:0:8369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+23:2365:x1873176850132992:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 417us (1486us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400923.269668:0:8369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 9 00000040:00080000:1.0:1786400923.270659:0:11546:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786400923.270666:0:11546:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786400923.271133:0:11546:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1786400923.271143:0:11546:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786400923.273640:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400923.273738:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850133248 00000100:00100000:0.0:1786400923.273750:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850133248 00000100:00100000:0.0:1786400923.273816:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 34 00000100:00100000:0.0:1786400923.273828:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+23:10553:x1873176850133248:12345-192.168.204.8@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1786400923.274118:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+24:10553:x1873176850133248:12345-192.168.204.8@tcp:35:lhsmtool_posix.0 Request processed in 288us (484us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1786400923.274140:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 34 00010000:00010000:3.0:1786400923.566950:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400924.399479:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786400924.399503:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872158720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786400924.399586:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400924.399651:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872158720 00000100:00100000:3.0:1786400924.399660:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872158720 00000100:00100000:3.0:1786400924.399710:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1786400924.399723:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1873176872158720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786400924.399761:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786400924.399805:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1873176872158720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400924.399812:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1786400924.399834:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786400924.399873:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872158720:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1786400924.591144:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400924.722466:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400924.722503:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400924.722910:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400924.722945:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850133760 00000100:00100000:0.0:1786400924.722955:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850133760 00000100:00100000:0.0:1786400924.723012:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 52 00000100:00100000:0.0:1786400924.723022:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fcbb15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+6:2362:x1873176850133760:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786400924.723109:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fcbb15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+6:2362:x1873176850133760:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 89us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400924.723117:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 52 00000100:00080000:0.0:1786400924.723264:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786400924.724170:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850133376 00000100:00100000:3.0:1786400924.724448:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850133376 00000100:00100000:3.0:1786400924.724644:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 286 00000100:00100000:3.0:1786400924.724665:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2363:x1873176850133376:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:3.0:1786400924.724720:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2363:x1873176850133376:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 57us (2268us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400924.724728:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 286 00000100:00100000:2.0:1786400924.725075:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850133504 00000100:00100000:2.0:1786400924.725080:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850133504 00000100:00100000:2.0:1786400924.725158:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 134 00000100:00100000:2.0:1786400924.725166:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+24:2362:x1873176850133504:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:2.0:1786400924.725396:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+24:2362:x1873176850133504:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 231us (2890us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400924.725415:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 134 00000100:00100000:0.0:1786400924.725605:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400924.725696:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400924.725786:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850133888 00000100:00100000:0.0:1786400924.725791:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850133888 00000100:00100000:0.0:1786400924.725830:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 135 00000100:00100000:0.0:1786400924.725838:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2363:x1873176850133888:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786400924.725875:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2363:x1873176850133888:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 38us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400924.725881:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 135 00000100:00080000:0.0:1786400924.725902:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786400924.726862:0:11770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850133632 00000100:00100000:2.0:1786400924.726871:0:11770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850133632 00000100:00100000:2.0:1786400924.726927:0:11770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 53 00000100:00100000:2.0:1786400924.726949:0:11770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:096c63d9-38b8-441b-8c71-343db25fe88a+5:2363:x1873176850133632:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:2.0:1786400924.726998:0:11770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:096c63d9-38b8-441b-8c71-343db25fe88a+5:2363:x1873176850133632:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 51us (1394us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400924.727005:0:11770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 53 00000100:00080000:0.0:1786400924.728475:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1786400924.806043:0:12019:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786400924.806053:0:12019:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786400924.806429:0:12019:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1786400924.806435:0:12019:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1786400924.910499:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872158976:0@lo:400:kworker.0 00000100:00100000:2.0:1786400924.910570:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400924.910624:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872159488:0@lo:400:kworker.0 00000100:00100000:2.0:1786400924.910652:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400924.910679:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872159232:0@lo:400:kworker.0 00000100:00100000:0.0:1786400924.910715:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400924.910783:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1786400924.910790:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872158848:0@lo:400:kworker.0 00000100:00100000:0.0:1786400924.910820:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400924.911145:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872158976 00000100:00100000:3.0:1786400924.911153:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872158976 00000100:00100000:3.0:1786400924.911275:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1786400924.911284:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872158976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400924.911332:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872158976:12345-0@lo:400:kworker.0 Request processed in 50us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400924.911339:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1786400924.911361:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1873176872159104:0@lo:400:kworker.0 00000100:00100000:3.0:1786400924.911385:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400924.911426:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872159104 00000100:00100000:3.0:1786400924.911429:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872159104 00000100:00100000:3.0:1786400924.911460:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1786400924.911465:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873176872159104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400924.911493:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873176872159104:12345-0@lo:400:kworker.0 Request processed in 28us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400924.911499:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:3.0:1786400924.911515:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400924.911542:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1873176872159104:0@lo:400:kworker.0 00000100:00100000:3.0:1786400924.911568:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872159488 00000100:00100000:3.0:1786400924.911570:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872159488 00000100:00100000:3.0:1786400924.911593:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872159232 00000100:00100000:3.0:1786400924.911595:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872159232 00000100:00100000:3.0:1786400924.911620:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1786400924.911626:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1873176872159488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400924.911652:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1873176872159488:12345-0@lo:400:kworker.0 Request processed in 27us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400924.911658:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1786400924.911667:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1786400924.912316:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1873176872159232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400924.912366:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1873176872159232:12345-0@lo:400:kworker.0 Request processed in 693us (1649us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400924.912373:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1786400924.912417:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1786400924.912532:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872158976:0@lo:400:kworker.0 00000100:00100000:2.0:1786400924.912544:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872159488:0@lo:400:kworker.0 00000100:00100000:3.0:1786400924.913152:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872158848 00000100:00100000:0.0:1786400924.913163:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873176872159360:0@lo:400:kworker.0 00000100:00100000:3.0:1786400924.913171:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872158848 00000100:00100000:0.0:1786400924.913203:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400924.913209:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1786400924.913216:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+19:3308:x1873176872158848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400924.913232:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872159232:0@lo:400:kworker.0 00000100:00100000:0.0:1786400924.913249:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872158848:0@lo:400:kworker.0 00000100:00100000:3.0:1786400924.913250:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+19:3308:x1873176872158848:12345-0@lo:400:kworker.0 Request processed in 35us (2429us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400924.913257:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1786400924.913429:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872159360 00000100:00100000:0.0:1786400924.913433:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872159360 00000100:00100000:1.0:1786400924.913449:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786400924.913458:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdbc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872159616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786400924.913466:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1786400924.913472:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873176872159360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400924.913487:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400924.913504:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873176872159360:12345-0@lo:400:kworker.0 Request processed in 32us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400924.913510:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1786400924.913513:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872159616 00000100:00100000:1.0:1786400924.913516:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872159616 00000100:00080000:0.0:1786400924.913523:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400924.913542:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1786400924.913542:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873176872159360:0@lo:400:kworker.0 00000100:00100000:1.0:1786400924.913548:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd000000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1873176872159616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786400924.913576:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400924.913628:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd000000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1873176872159616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400924.913634:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1786400924.913826:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdbc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872159616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786400924.963444:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400924.966882:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850134144 00000100:00100000:3.0:1786400924.966898:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850134144 00000100:00100000:3.0:1786400924.966973:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 133 00000100:00100000:3.0:1786400924.966985:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+24:10574:x1873176850134144:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:3.0:1786400924.967005:0:6615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400924.967163:0:6615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091600/0x5ccaaf4f3cb1e1c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bd09 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400924.967264:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091000/0x5ccaaf4f3cb1e1d0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400924.967286:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091000/0x5ccaaf4f3cb1e1d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400924.967299:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091000/0x5ccaaf4f3cb1e1d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400924.967312:0:6615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1786400924.967460:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091600/0x5ccaaf4f3cb1e1c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd09 expref: 27 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400924.967479:0:6615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091000/0x5ccaaf4f3cb1e1d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd09 expref: 26 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400924.967488:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d6fc5599c00) 00010000:00010000:3.0:1786400924.967490:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1786400924.967494:0:6615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca091000, rc 0) 00000100:00100000:3.0:1786400924.967607:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+26:10574:x1873176850134144:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 625us (4172us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1786400924.967615:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 133 00000100:00100000:2.0:1786400924.990644:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400924.990701:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850134272 00000100:00100000:2.0:1786400924.990711:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850134272 00000100:00100000:2.0:1786400924.990768:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 134 00000100:00100000:2.0:1786400924.990779:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+26:10574:x1873176850134272:12345-192.168.204.8@tcp:54:lfs.0 00010000:00010000:2.0:1786400924.990850:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e1de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400924.990868:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e1de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400924.990881:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e1de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400924.990910:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e1de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400924.990927:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e1de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400924.990934:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e1de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400924.990940:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1bba00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400924.990944:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e1de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400924.990952:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e1de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400924.990964:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d6fc5599c00) 00010000:00010000:2.0:1786400924.990968:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786400924.990972:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e1de lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400924.990978:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e1de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400924.994426:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+26:10574:x1873176850134272:12345-192.168.204.8@tcp:54:lfs.0 Request processed in 3635us (3780us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400924.994443:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 134 00000100:00100000:2.0:1786400925.078590:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400925.078971:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850134400 00000100:00100000:3.0:1786400925.078984:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850134400 00000100:00100000:3.0:1786400925.079378:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 47 00000100:00100000:3.0:1786400925.079405:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+6:2364:x1873176850134400:12345-192.168.204.8@tcp:101:cat.0 00010000:00010000:3.0:1786400925.079431:0:6593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400925.079462:0:6593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1e1e5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bd10 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786400925.079602:0:6593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a7a5098, atime: 0x6a7a5097, ctime: 0x6a7a5098, blocks: 0xb 00010000:00010000:3.0:1786400925.079631:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=377s v=(0 0) 00010000:00010000:3.0:1786400925.079636:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400925.079663:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1e1e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd10 expref: 7 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400925.079688:0:6593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1e1e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd10 expref: 7 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400925.079706:0:6593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca091600, rc 0) 00000100:00100000:3.0:1786400925.079780:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+7:2364:x1873176850134400:12345-192.168.204.8@tcp:101:cat.0 Request processed in 391us (1203us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400925.079788:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 47 00000100:00100000:1.0:1786400925.087611:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400925.087841:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850134528 00000100:00100000:0.0:1786400925.087851:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850134528 00002000:00100000:0.0:1786400925.087905:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9d6ffd001c00 x1873176850134528/t0(0) o3->096c63d9-38b8-441b-8c71-343db25fe88a@192.168.204.8@tcp:721/0 lens 488/0 e 0 to 0 dl 1786400936 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786400925.087917:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ffd001c00 with x1873176850134528 ext(0->4095) 00002000:00010000:0.0:1786400925.087935:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d6ffd001c00 00000100:00100000:0.0:1786400925.088115:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4 00000100:00100000:0.0:1786400925.088125:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd001c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:096c63d9-38b8-441b-8c71-343db25fe88a+7:2365:x1873176850134528:12345-192.168.204.8@tcp:3:cat.0 00000100:00100000:0.0:1786400925.088446:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd001c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:096c63d9-38b8-441b-8c71-343db25fe88a+7:2365:x1873176850134528:12345-192.168.204.8@tcp:3:cat.0 Request processed in 322us (845us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1786400925.088454:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4 00002000:00100000:0.0:1786400925.088463:0:6597:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9d6ffd001c00 x1873176850134528/t0(0) o3->096c63d9-38b8-441b-8c71-343db25fe88a@192.168.204.8@tcp:721/0 lens 488/4536 e 0 to 0 dl 1786400936 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1786400925.088471:0:6597:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ffd001c00 with x1873176850134528 ext(0->4095) 00002000:00010000:0.0:1786400925.088475:0:6597:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d6ffd001c00 00010000:00010000:3.0:1786400925.614394:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1786400926.536400:0:6619:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00010000:00010000:3.0:1786400926.643133:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1786400927.585525:0:7501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1786400927.585543:0:7501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:1.0:1786400927.585548:0:7501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:1.0:1786400927.625374:0:5810:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:1.0:1786400927.625399:0:5810:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d6ec5984f00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1786400927.625404:0:5810:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d6fc923a800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d6ec5984b40 00000020:00080000:1.0:1786400927.625407:0:5810:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d6fc923a100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d6ffdbef800 00000020:00080000:3.0:1786400927.625714:0:5822:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 1 00000020:00080000:3.0:1786400927.625943:0:5822:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1786400927.630667:0:5810:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:0.0:1786400927.640716:0:11928:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00010000:00010000:2.0:1786400927.663185:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400928.686553:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400929.523958:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786400929.523991:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd000e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872159744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786400929.524119:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400929.524281:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872159744 00000100:00100000:1.0:1786400929.524292:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872159744 00000100:00100000:1.0:1786400929.524368:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1786400929.524379:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5fbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872159744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786400929.524509:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400929.524564:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5fbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872159744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 187us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400929.524572:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1786400929.524623:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1786400929.524629:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d6ffdc99c00, transno 4294967304 00000100:00100000:1.0:1786400929.524650:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd000e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872159744:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1786400929.525458:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1786400929.715383:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400929.841605:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400929.842735:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850134784 00000100:00100000:3.0:1786400929.842753:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850134784 00000100:00080000:0.0:1786400929.842859:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400929.843074:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400929.843141:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400929.843179:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400929.843347:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850134912 00000100:00100000:0.0:1786400929.843353:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850134912 00000100:00100000:0.0:1786400929.843440:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 56 00000100:00100000:0.0:1786400929.843453:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd000e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+5:2364:x1873176850134912:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:2.0:1786400929.843600:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850134656 00000100:00100000:2.0:1786400929.843605:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850134656 00000100:00100000:2.0:1786400929.843661:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 288 00000100:00100000:2.0:1786400929.843670:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2364:x1873176850134656:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:3.0:1786400929.843901:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850135168 00000100:00100000:3.0:1786400929.843907:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850135168 00000100:00100000:0.0:1786400929.843935:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd000e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+5:2364:x1873176850134912:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 482us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400929.843944:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 139 00000100:00100000:0.0:1786400929.843949:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 56 00000100:00100000:3.0:1786400929.843958:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+13:2365:x1873176850134784:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786400929.843989:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 140 00000100:00100000:0.0:1786400929.843998:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc926b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2364:x1873176850135168:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:2.0:1786400929.844290:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2364:x1873176850134656:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 620us (1220us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400929.844310:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 288 00000100:00100000:1.0:1786400929.844493:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400929.844875:0:11770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850135040 00000100:00100000:2.0:1786400929.844905:0:11770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850135040 00000100:00100000:2.0:1786400929.845012:0:11770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 57 00000100:00100000:2.0:1786400929.845021:0:11770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9269500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:096c63d9-38b8-441b-8c71-343db25fe88a+6:2365:x1873176850135040:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:2.0:1786400929.845057:0:11770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9269500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:096c63d9-38b8-441b-8c71-343db25fe88a+6:2365:x1873176850135040:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 38us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400929.845064:0:11770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 57 00000100:00080000:1.0:1786400929.845576:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786400929.845582:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786400929.845584:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786400929.846585:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+13:2365:x1873176850134784:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 2622us (4987us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400929.846764:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 139 00000100:00100000:0.0:1786400929.846782:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc926b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2364:x1873176850135168:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 2782us (3598us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400929.846794:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 140 00000100:00100000:1.0:1786400929.866936:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400929.867066:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850135296 00000100:00100000:2.0:1786400929.867079:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850135296 00000100:00100000:2.0:1786400929.867405:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 135 00000100:00100000:2.0:1786400929.867418:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc926a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+13:10219:x1873176850135296:12345-192.168.204.8@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1786400929.867634:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc926a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+13:10219:x1873176850135296:12345-192.168.204.8@tcp:60:lhsmtool_posix.0 Request processed in 217us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400929.867645:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 135 00000100:00100000:2.0:1786400929.870978:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400929.871081:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850135552 00000100:00100000:1.0:1786400929.871327:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850135552 00000100:00100000:1.0:1786400929.871469:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 35 00000100:00100000:1.0:1786400929.871482:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+13:10219:x1873176850135552:12345-192.168.204.8@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1786400929.872355:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+14:10219:x1873176850135552:12345-192.168.204.8@tcp:35:lhsmtool_posix.0 Request processed in 871us (1385us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1786400929.872366:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 35 00000100:00100000:2.0:1786400930.030738:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872160256:0@lo:400:kworker.0 00000100:00100000:1.0:1786400930.030738:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872160000:0@lo:400:kworker.0 00000100:00100000:3.0:1786400930.030766:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:97b0324f-e214-4822-8711-e150ddac2a7e:3309:1873176872159872:0@lo:400:kworker.0 00000100:00100000:0.0:1786400930.031676:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1873176872160128:0@lo:400:kworker.0 00000100:00100000:2.0:1786400930.031972:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400930.031988:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400930.032019:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400930.032323:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872159872 00000100:00100000:3.0:1786400930.032324:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873176872160384:0@lo:400:kworker.0 00000100:00100000:2.0:1786400930.032336:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872159872 00000100:00100000:0.0:1786400930.032342:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872160640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786400930.032383:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400930.032408:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1786400930.032421:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+19:3309:x1873176872159872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400930.032480:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872160128 00000100:00100000:3.0:1786400930.032489:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872160128 00000100:00100000:2.0:1786400930.032532:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+19:3309:x1873176872159872:12345-0@lo:400:kworker.0 Request processed in 112us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400930.032544:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1786400930.032558:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400930.032589:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872160384 00000100:00100000:3.0:1786400930.032597:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872160384 00000100:00100000:2.0:1786400930.032620:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872160256 00000100:00100000:0.0:1786400930.032620:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872160640 00000100:00100000:2.0:1786400930.032629:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872160256 00000100:00100000:0.0:1786400930.032629:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872160640 00000100:00100000:3.0:1786400930.032648:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1786400930.032665:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873176872160128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400930.032683:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1786400930.032689:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1786400930.032697:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872160256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400930.032705:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee30ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872160640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786400930.032750:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786400930.032759:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873176872160128:12345-0@lo:400:kworker.0 Request processed in 99us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400930.032767:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1786400930.032797:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1786400930.032804:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872160256:12345-0@lo:400:kworker.0 Request processed in 98us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400930.032815:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873176872160384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400930.032825:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1786400930.032880:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873176872160384:12345-0@lo:400:kworker.0 Request processed in 72us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400930.032888:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1786400930.032893:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872160256:0@lo:400:kworker.0 00000100:00100000:3.0:1786400930.032940:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:97b0324f-e214-4822-8711-e150ddac2a7e:3309:1873176872159872:0@lo:400:kworker.0 00000100:00100000:3.0:1786400930.032958:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873176872160384:0@lo:400:kworker.0 00000100:00080000:2.0:1786400930.032992:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786400930.033000:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400930.033282:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee30ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872160640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 581us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400930.033291:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1786400930.033345:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1873176872160128:0@lo:400:kworker.0 00000100:00100000:0.0:1786400930.033355:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1786400930.033361:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d6ffdc99500, transno 4294967311 00000004:00080000:0.0:1786400930.033371:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:0.0:1786400930.033397:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872160640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786400930.034680:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400930.034897:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872160512:0@lo:400:kworker.0 00000100:00100000:1.0:1786400930.034945:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400930.035182:0:11770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872160512 00000100:00100000:3.0:1786400930.035190:0:11770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872160512 00000100:00100000:3.0:1786400930.036074:0:11770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1786400930.036127:0:11770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fe9205500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872160512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400930.036155:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872160000 00000100:00100000:2.0:1786400930.036232:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872160000 00000100:00100000:3.0:1786400930.036246:0:11770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fe9205500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872160512:12345-0@lo:400:kworker.0 Request processed in 161us (1299us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400930.036254:0:11770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1786400930.036358:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1786400930.036368:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fe9205180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872160000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400930.036561:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872160512:0@lo:400:kworker.0 00000100:00100000:2.0:1786400930.036598:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fe9205180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872160000:12345-0@lo:400:kworker.0 Request processed in 231us (1922us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400930.036601:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872160000:0@lo:400:kworker.0 00000100:00100000:2.0:1786400930.036605:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1786400930.118379:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400930.118472:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850135680 00000100:00100000:2.0:1786400930.118486:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850135680 00000100:00100000:3.0:1786400930.118591:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 136 00000100:00100000:3.0:1786400930.118604:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:11026:x1873176850135680:12345-192.168.204.8@tcp:101:lsof.0 00010000:00010000:3.0:1786400930.118630:0:6615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400930.118656:0:6615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090400/0x5ccaaf4f3cb1e1ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bd17 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400930.118735:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e1f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400930.118750:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e1f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400930.118763:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e1f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400930.121124:0:6615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1786400930.121139:0:6615:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1786400930.121343:0:6615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e1f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400930.121399:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090400/0x5ccaaf4f3cb1e1ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd17 expref: 7 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400930.121425:0:6615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e1f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd17 expref: 6 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400930.121449:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fd022e500) 00010000:00010000:3.0:1786400930.121453:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786400930.121457:0:6615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca090e00, rc 0) 00000100:00100000:3.0:1786400930.122479:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+6:11026:x1873176850135680:12345-192.168.204.8@tcp:101:lsof.0 Request processed in 3868us (4104us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400930.122495:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 136 00000040:00080000:0.0:1786400930.478602:0:11546:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786400930.478617:0:11546:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786400930.478981:0:11546:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1786400930.478990:0:11546:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1786400930.735172:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400931.759063:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1786400932.708917:0:11928:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1786400932.708948:0:11928:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1786400932.709103:0:5822:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1786400932.709132:0:5822:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1786400932.783051:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786400933.082404:0:12224:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 18:28:50 (1786400930) 00010000:00010000:3.0:1786400933.806402:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400934.272293:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400934.273859:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850135936 00000100:00100000:2.0:1786400934.273891:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850135936 00000100:00100000:2.0:1786400934.273963:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 137 00000100:00100000:2.0:1786400934.273975:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+13:11290:x1873176850135936:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786400934.274003:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400934.274026:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bac00/0x5ccaaf4f3cb1e1fa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bd1e expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400934.274120:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba200/0x5ccaaf4f3cb1e201 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400934.274133:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba200/0x5ccaaf4f3cb1e201 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400934.274144:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba200/0x5ccaaf4f3cb1e201 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400934.274195:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb400/0x5ccaaf4f3cb1e208 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400934.274203:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb400/0x5ccaaf4f3cb1e208 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400934.274221:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb400/0x5ccaaf4f3cb1e208 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400934.274745:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bae00/0x5ccaaf4f3cb1e20f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400934.274756:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bae00/0x5ccaaf4f3cb1e20f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400934.274765:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bae00/0x5ccaaf4f3cb1e20f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400934.274782:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1786400934.274992:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba200/0x5ccaaf4f3cb1e201 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400934.275001:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba200/0x5ccaaf4f3cb1e201 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400934.275007:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba200/0x5ccaaf4f3cb1e201 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400934.275014:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1ba200 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400934.275018:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba200/0x5ccaaf4f3cb1e201 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400934.275027:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba200/0x5ccaaf4f3cb1e201 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400934.275039:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d6fe06cb400) 00010000:00010000:2.0:1786400934.275043:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400934.275047:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba200/0x5ccaaf4f3cb1e201 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400934.275054:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba200/0x5ccaaf4f3cb1e201 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400934.275066:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb400/0x5ccaaf4f3cb1e208 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400934.275073:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb400/0x5ccaaf4f3cb1e208 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400934.275132:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb400/0x5ccaaf4f3cb1e208 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400934.275137:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1bb400 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400934.275140:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb400/0x5ccaaf4f3cb1e208 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400934.275146:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb400/0x5ccaaf4f3cb1e208 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400934.275156:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9d6fd022e300) 00010000:00010000:2.0:1786400934.275158:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400934.275161:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb400/0x5ccaaf4f3cb1e208 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400934.275166:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb400/0x5ccaaf4f3cb1e208 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400934.275538:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bac00/0x5ccaaf4f3cb1e1fa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd1e expref: 16 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400934.275554:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bae00/0x5ccaaf4f3cb1e20f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd1e expref: 15 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400934.275562:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d6fc5599600) 00010000:00010000:2.0:1786400934.275564:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400934.275567:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fee1bae00, rc 0) 00000100:00100000:2.0:1786400934.275636:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+15:11290:x1873176850135936:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 1663us (3352us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1786400934.275652:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 137 00000100:00080000:1.0:1786400934.276078:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786400934.290748:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400934.290861:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400934.290964:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850136192 00000100:00100000:1.0:1786400934.290974:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850136192 00000100:00100000:1.0:1786400934.291041:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 10 00000100:00100000:1.0:1786400934.291051:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096c63d9-38b8-441b-8c71-343db25fe88a+15:2362:x1873176850136192:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400934.291067:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400934.291125:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bae00/0x5ccaaf4f3cb1e20f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd1e expref: 15 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400934.291164:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d6fc5599600) 00010000:00010000:1.0:1786400934.291170:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400934.291248:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096c63d9-38b8-441b-8c71-343db25fe88a+14:2362:x1873176850136192:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 197us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400934.291257:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 10 00000100:00100000:0.0:1786400934.291773:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850136064 00000100:00100000:0.0:1786400934.291779:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850136064 00000100:00100000:0.0:1786400934.291871:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 138 00000100:00100000:0.0:1786400934.291879:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+14:11290:x1873176850136064:12345-192.168.204.8@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1786400934.291986:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+14:11290:x1873176850136064:12345-192.168.204.8@tcp:59:lhsmtool_posix.0 Request processed in 108us (1250us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400934.291994:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 138 00000040:00080000:1.0:1786400934.579772:0:11546:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786400934.579783:0:11546:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786400934.579819:0:11546:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1786400934.579824:0:11546:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786400934.639039:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786400934.639073:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fe9205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872160768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786400934.639395:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400934.644760:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872160768 00000100:00100000:2.0:1786400934.644774:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872160768 00000100:00100000:2.0:1786400934.644876:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1786400934.644890:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872160768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786400934.644934:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400934.645032:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872160768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (5638us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400934.645040:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1786400934.645147:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786400934.645226:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fe9205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872160768:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1786400934.832329:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400934.965769:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400934.965833:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400934.967258:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850136320 00000100:00100000:0.0:1786400934.967279:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850136320 00000100:00100000:0.0:1786400934.967362:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 290 00000100:00100000:0.0:1786400934.967374:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2365:x1873176850136320:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786400934.967473:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2365:x1873176850136320:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 101us (1719us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400934.967481:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 290 00000100:00100000:0.0:1786400934.973433:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400934.973474:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400934.981266:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400934.981274:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850136576 00000100:00100000:3.0:1786400934.981289:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850136576 00000100:00100000:0.0:1786400934.981305:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850136448 00000100:00100000:3.0:1786400934.981371:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850136704 00000100:00100000:3.0:1786400934.981376:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850136704 00000100:00100000:3.0:1786400934.981408:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 60 00000100:00100000:3.0:1786400934.981420:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+5:2365:x1873176850136576:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786400934.981455:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850136448 00000100:00100000:0.0:1786400934.981500:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850136832 00000100:00100000:0.0:1786400934.981504:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850136832 00000100:00100000:3.0:1786400934.981518:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+5:2365:x1873176850136576:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 99us (15682us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400934.981528:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 60 00000100:00100000:0.0:1786400934.981536:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 144 00000100:00100000:0.0:1786400934.981548:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+14:2365:x1873176850136448:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:3.0:1786400934.981555:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 61 00000100:00100000:3.0:1786400934.981576:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+6:2365:x1873176850136704:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786400934.981591:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+14:2365:x1873176850136448:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 45us (8171us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400934.981599:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 144 00000100:00100000:3.0:1786400934.981615:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+6:2365:x1873176850136704:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 39us (8137us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400934.981619:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 145 00000100:00100000:3.0:1786400934.981629:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 61 00000100:00100000:0.0:1786400934.981635:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+6:2364:x1873176850136832:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786400934.981672:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+6:2364:x1873176850136832:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 43us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400934.981681:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 145 00000100:00080000:0.0:1786400934.982188:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786400934.982212:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786400934.982215:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786400935.150855:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:97b0324f-e214-4822-8711-e150ddac2a7e:3309:1873176872160896:0@lo:400:kworker.0 00000100:00100000:1.0:1786400935.151012:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400935.151224:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786400935.151233:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873176872161280:0@lo:400:kworker.0 00000100:00100000:1.0:1786400935.151267:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400935.151310:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872160896 00000100:00100000:1.0:1786400935.151319:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872160896 00000100:00100000:1.0:1786400935.151665:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1786400935.151677:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+19:3309:x1873176872160896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400935.151749:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+19:3309:x1873176872160896:12345-0@lo:400:kworker.0 Request processed in 73us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400935.151752:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1873176872161152:0@lo:400:kworker.0 00000100:00100000:1.0:1786400935.151760:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1786400935.151799:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400935.151805:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872161024:0@lo:400:kworker.0 00000100:00100000:1.0:1786400935.151838:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400935.151852:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872161280 00000100:00100000:3.0:1786400935.151857:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872161280 00000100:00100000:1.0:1786400935.151878:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872161152 00000100:00100000:1.0:1786400935.151892:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872161152 00000100:00100000:3.0:1786400935.151903:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872161024 00000100:00100000:3.0:1786400935.151908:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872161024 00000100:00100000:1.0:1786400935.151924:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1786400935.151933:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fe9206a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873176872161280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400935.151967:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fe9206a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873176872161280:12345-0@lo:400:kworker.0 Request processed in 36us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400935.152029:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786400935.152041:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872161408:0@lo:400:kworker.0 00000100:00100000:2.0:1786400935.152077:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400935.152135:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872161408 00000100:00100000:2.0:1786400935.152139:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872161408 00000100:00100000:2.0:1786400935.152171:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1786400935.152178:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872161408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400935.152230:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872161408:12345-0@lo:400:kworker.0 Request processed in 52us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400935.152237:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1786400935.152283:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872161408:0@lo:400:kworker.0 00000100:00080000:2.0:1786400935.152318:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786400935.152324:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400935.152583:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1786400935.152592:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873176872161152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400935.152636:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873176872161152:12345-0@lo:400:kworker.0 Request processed in 46us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400935.152644:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1786400935.152658:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1786400935.152664:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fe9207800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872161024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400935.152701:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fe9207800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872161024:12345-0@lo:400:kworker.0 Request processed in 37us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400935.152707:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1786400935.152740:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1873176872161152:0@lo:400:kworker.0 00000100:00100000:0.0:1786400935.153627:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786400935.153720:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872161536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786400935.153776:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1786400935.153782:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400935.153839:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872161024:0@lo:400:kworker.0 00000100:00100000:1.0:1786400935.153874:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873176872161280:0@lo:400:kworker.0 00000100:00100000:1.0:1786400935.153886:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:97b0324f-e214-4822-8711-e150ddac2a7e:3309:1873176872160896:0@lo:400:kworker.0 00000100:00100000:3.0:1786400935.154379:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872161536 00000100:00100000:3.0:1786400935.154388:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872161536 00000100:00100000:3.0:1786400935.154614:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1786400935.154627:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d7000dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872161536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786400935.154697:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786400935.154767:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d7000dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872161536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400935.154774:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1786400935.154842:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872161536:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1786400935.854397:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400936.699132:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400936.700076:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850136960 00000100:00100000:3.0:1786400936.700115:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850136960 00000100:00100000:3.0:1786400936.700812:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 139 00000100:00100000:3.0:1786400936.700828:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d7000dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+14:11333:x1873176850136960:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:3.0:1786400936.700854:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400936.700879:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090200/0x5ccaaf4f3cb1e21d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bd25 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.700962:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090400/0x5ccaaf4f3cb1e224 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.701452:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090400/0x5ccaaf4f3cb1e224 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.701472:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090400/0x5ccaaf4f3cb1e224 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.701495:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091400/0x5ccaaf4f3cb1e22b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.701503:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091400/0x5ccaaf4f3cb1e22b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.701510:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091400/0x5ccaaf4f3cb1e22b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.705622:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090400/0x5ccaaf4f3cb1e224 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.706268:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090400/0x5ccaaf4f3cb1e224 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.706282:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090400/0x5ccaaf4f3cb1e224 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.706288:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca090400 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786400936.706294:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090400/0x5ccaaf4f3cb1e224 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.706304:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090400/0x5ccaaf4f3cb1e224 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.706329:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fd022e500) 00010000:00010000:3.0:1786400936.706332:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400936.706339:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090400/0x5ccaaf4f3cb1e224 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.706344:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090400/0x5ccaaf4f3cb1e224 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.706364:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091400/0x5ccaaf4f3cb1e22b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.706370:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091400/0x5ccaaf4f3cb1e22b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.706376:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091400/0x5ccaaf4f3cb1e22b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.706397:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca091400 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786400936.706400:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091400/0x5ccaaf4f3cb1e22b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.706406:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091400/0x5ccaaf4f3cb1e22b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.706415:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9d6fc5599b00) 00010000:00010000:3.0:1786400936.706418:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400936.706421:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091400/0x5ccaaf4f3cb1e22b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.706427:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091400/0x5ccaaf4f3cb1e22b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.707139:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090200/0x5ccaaf4f3cb1e21d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd25 expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.707243:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fd022e500) 00010000:00010000:3.0:1786400936.707247:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400936.707253:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090200/0x5ccaaf4f3cb1e21d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd25 expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.707267:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca090200, rc 0) 00000100:00100000:3.0:1786400936.707370:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d7000dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+14:11333:x1873176850136960:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 6545us (8298us total) trans 0 rc 301/301 00000100:00100000:3.0:1786400936.707381:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 139 00000100:00080000:3.0:1786400936.709766:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400936.718980:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400936.719803:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850137216 00000100:00100000:0.0:1786400936.719824:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850137216 00000100:00100000:0.0:1786400936.721079:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 140 00000100:00100000:0.0:1786400936.721131:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+14:11333:x1873176850137216:12345-192.168.204.8@tcp:36:lfs.0 00010000:00010000:0.0:1786400936.721229:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400936.721267:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c800/0x5ccaaf4f3cb1db9b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb5e expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400936.721293:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fd022e500) 00010000:00010000:0.0:1786400936.721299:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786400936.723126:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e232 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400936.723176:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e1f3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd17 expref: 5 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400936.723188:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e232 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400936.723248:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e1f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd17 expref: 5 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400936.723268:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e1f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd17 expref: 5 pid: 6615 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400936.723287:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f9b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5788:1873176872161664:192.168.204.8@tcp:104: 00000100:00100000:0.0:1786400936.723423:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff6ec9600 going to sleep for 11 seconds 00000100:00100000:3.0:1786400936.727935:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400936.728593:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f9b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5788:1873176872161664:192.168.204.8@tcp:104: 00010000:00010000:1.0:1786400936.728630:0:5788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e232 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400936.728730:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850137344 00000100:00100000:2.0:1786400936.728739:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850137344 00010000:00010000:2.0:1786400936.728814:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e1f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd17 expref: 6 pid: 6615 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400936.728855:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 61 00000100:00100000:2.0:1786400936.728866:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6083100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+6:2364:x1873176850137344:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786400936.728886:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400936.728894:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e1f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd17 expref: 6 pid: 6615 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400936.728909:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e1f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd17 expref: 6 pid: 6615 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400936.728939:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e1f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd17 expref: 6 pid: 6615 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400936.728957:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fd022e500) 00010000:00010000:2.0:1786400936.728982:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e232 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400936.728995:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e232 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400936.729003:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e232 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400936.729029:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400936.729112:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6083100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2364:x1873176850137344:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 246us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400936.729132:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 61 00000100:00080000:1.0:1786400936.730527:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786400936.730555:0:5788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e232 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400936.730568:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e232 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400936.730605:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e239 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400936.730619:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e239 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400936.730631:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e239 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400936.734857:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1786400936.734958:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e232 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400936.735038:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e232 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400936.735047:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e232 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400936.735054:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aa200 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400936.735060:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e232 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400936.735069:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e232 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400936.735217:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fd022e500) 00010000:00010000:2.0:1786400936.735221:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400936.735227:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e232 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400936.735235:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e232 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786400936.735265:0:5788:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000078807876 reply state 00000000993d657b transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e239 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400936.735280:0:5788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786400936.735719:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+15:11333:x1873176850137216:12345-192.168.204.8@tcp:36:lfs.0 Request processed in 14491us (16639us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1786400936.735731:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 140 00010000:00010000:3.0:1786400936.738696:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e239 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.738716:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e239 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.738726:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e239 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.738733:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138ee00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786400936.738739:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e239 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.738749:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e239 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.738770:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9d6fe06cbf00) 00010000:00010000:3.0:1786400936.738774:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400936.738779:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e239 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.738785:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e239 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400936.879206:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400936.882075:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400936.890427:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850137472 00000100:00100000:3.0:1786400936.890447:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850137472 00000100:00100000:3.0:1786400936.891445:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 141 00000100:00100000:3.0:1786400936.891465:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+14:11341:x1873176850137472:12345-192.168.204.8@tcp:101:lctl.0 00010000:00010000:3.0:1786400936.891501:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400936.891552:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090200/0x5ccaaf4f3cb1e240 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bd2c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.891780:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091400/0x5ccaaf4f3cb1e247 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.891798:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091400/0x5ccaaf4f3cb1e247 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.891812:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091400/0x5ccaaf4f3cb1e247 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400936.891965:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1786400936.891970:0:5789:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1786400936.892281:0:5789:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091400/0x5ccaaf4f3cb1e247 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.892315:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090200/0x5ccaaf4f3cb1e240 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd2c expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.892336:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091400/0x5ccaaf4f3cb1e247 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd2c expref: 15 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.892346:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fc5599b00) 00010000:00010000:3.0:1786400936.892350:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786400936.892354:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca091400, rc 0) 00000100:00100000:3.0:1786400936.892450:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+15:11341:x1873176850137472:12345-192.168.204.8@tcp:101:lctl.0 Request processed in 993us (10393us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400936.892458:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 141 00000100:00100000:0.0:1786400936.960676:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400936.960952:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850137600 00000100:00100000:2.0:1786400936.960979:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850137600 00000100:00100000:2.0:1786400936.961248:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 142 00000100:00100000:2.0:1786400936.961262:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+15:11347:x1873176850137600:12345-192.168.204.8@tcp:101:bash.0 00010000:00010000:2.0:1786400936.961294:0:6615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400936.961324:0:6615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e24e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bd33 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.962805:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090200/0x5ccaaf4f3cb1e255 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.962860:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090200/0x5ccaaf4f3cb1e255 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.964249:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090200/0x5ccaaf4f3cb1e255 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.964301:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090400/0x5ccaaf4f3cb1e25c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.964316:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090400/0x5ccaaf4f3cb1e25c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.964328:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090400/0x5ccaaf4f3cb1e25c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.964894:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091200/0x5ccaaf4f3cb1e263 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.964907:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091200/0x5ccaaf4f3cb1e263 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.964916:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091200/0x5ccaaf4f3cb1e263 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400936.965221:0:6615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1786400936.965228:0:6615:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786400936.965271:0:6615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091200/0x5ccaaf4f3cb1e263 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.965289:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090200/0x5ccaaf4f3cb1e255 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.965319:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090200/0x5ccaaf4f3cb1e255 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.965327:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090200/0x5ccaaf4f3cb1e255 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.965335:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca090200 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786400936.965345:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090200/0x5ccaaf4f3cb1e255 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.965353:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090200/0x5ccaaf4f3cb1e255 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.965774:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fc5599b00) 00010000:00010000:3.0:1786400936.965779:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400936.965786:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090200/0x5ccaaf4f3cb1e255 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.965793:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090200/0x5ccaaf4f3cb1e255 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.965813:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090400/0x5ccaaf4f3cb1e25c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.965819:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090400/0x5ccaaf4f3cb1e25c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.965825:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090400/0x5ccaaf4f3cb1e25c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.965831:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca090400 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786400936.965843:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090400/0x5ccaaf4f3cb1e25c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.965850:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090400/0x5ccaaf4f3cb1e25c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.965859:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9d6fc5599800) 00010000:00010000:3.0:1786400936.965863:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400936.965865:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090400/0x5ccaaf4f3cb1e25c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.965872:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090400/0x5ccaaf4f3cb1e25c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.966015:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e24e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd33 expref: 17 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.966033:0:6615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091200/0x5ccaaf4f3cb1e263 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd33 expref: 16 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.966042:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d6fc5599e00) 00010000:00010000:3.0:1786400936.966044:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1786400936.966047:0:6615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca091200, rc 0) 00000100:00100000:3.0:1786400936.966339:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+16:11347:x1873176850137600:12345-192.168.204.8@tcp:101:bash.0 Request processed in 5077us (5987us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400936.966352:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 142 00000100:00100000:0.0:1786400936.973999:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400936.974484:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850137856 00000100:00100000:1.0:1786400936.974496:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850137856 00000100:00100000:1.0:1786400936.974561:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 143 00000100:00100000:1.0:1786400936.974571:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd61f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+16:11347:x1873176850137856:12345-192.168.204.8@tcp:101:bash.0 00010000:00010000:1.0:1786400936.974593:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400936.974615:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1e26a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bd3a expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400936.974767:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e271 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400936.974783:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e271 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400936.974795:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e271 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400936.974865:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e278 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400936.974873:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e278 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400936.974895:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e278 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786400936.977666:0:5790:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1786400936.977867:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e27f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400936.977960:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e27f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400936.977973:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e27f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400936.978016:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e271 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400936.978023:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e271 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400936.978029:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e271 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400936.978035:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138f800 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400936.978040:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e271 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400936.978047:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e271 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400936.978060:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d6fc5599e00) 00010000:00010000:1.0:1786400936.978063:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400936.978067:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e271 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400936.978271:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e271 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786400936.978286:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000093633f6e reply state 000000007776eba6 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e278 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400936.978296:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786400936.978333:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1e26a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd3a expref: 19 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400936.978349:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e27f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd3a expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400936.978356:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fe06cbe00) 00010000:00010000:1.0:1786400936.978359:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786400936.978361:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138f400, rc 0) 00000100:00100000:1.0:1786400936.978497:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd61f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+19:11347:x1873176850137856:12345-192.168.204.8@tcp:101:bash.0 Request processed in 3925us (4507us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1786400936.978506:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 143 00010000:00010000:1.0:1786400936.982023:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e278 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400936.982041:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e278 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400936.982048:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e278 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400936.982054:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138fa00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400936.982067:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e278 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400936.982076:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e278 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400936.982228:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d6fe06cbb00) 00010000:00010000:1.0:1786400936.982233:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400936.982239:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e278 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400936.982246:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e278 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400936.984081:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400936.984549:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850137984 00000100:00100000:2.0:1786400936.984563:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850137984 00000100:00100000:2.0:1786400936.984789:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 48 00000100:00100000:2.0:1786400936.984800:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd61dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+5:2365:x1873176850137984:12345-192.168.204.8@tcp:101:bash.0 00010000:00010000:2.0:1786400936.984823:0:6593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400936.984845:0:6593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d15db91/0x5ccaaf4f3cb1e28d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bd41 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786400936.984872:0:6593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786400936.984903:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=389s v=(0 0) 00010000:00010000:2.0:1786400936.984908:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400936.984917:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d15db91/0x5ccaaf4f3cb1e28d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd41 expref: 6 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400936.984936:0:6593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000d15db91/0x5ccaaf4f3cb1e28d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd41 expref: 6 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400936.984948:0:6593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fee1ba000, rc 0) 00000100:00100000:2.0:1786400936.985029:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd61dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+6:2365:x1873176850137984:12345-192.168.204.8@tcp:101:bash.0 Request processed in 231us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400936.985037:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 48 00000100:00080000:1.0:1786400936.986505:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786400936.988767:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400936.988853:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850138112 00000100:00100000:3.0:1786400936.988864:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850138112 00000100:00100000:3.0:1786400936.988953:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 49 00000100:00100000:3.0:1786400936.988963:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+6:11347:x1873176850138112:12345-192.168.204.8@tcp:101:bash.0 00010000:00010000:3.0:1786400936.988995:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400936.989016:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000209afceb/0x5ccaaf4f3cb1e294 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bd48 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.989141:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000d15db91/0x5ccaaf4f3cb1e28d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd41 expref: 7 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.989152:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400936.989192:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400936.989199:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000209afceb/0x5ccaaf4f3cb1e294 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd48 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.989234:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000d15db91/0x5ccaaf4f3cb1e28d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd41 expref: 7 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.989247:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000d15db91/0x5ccaaf4f3cb1e28d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd41 expref: 7 pid: 6593 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400936.989262:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc6080e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6590:1873176872161792:192.168.204.8@tcp:104: 00000100:00100000:3.0:1786400936.989351:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc137ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1786400936.994555:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400936.994664:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc6080e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6590:1873176872161792:192.168.204.8@tcp:104: 00010000:00010000:3.0:1786400936.994705:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000209afceb/0x5ccaaf4f3cb1e294 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd48 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400936.994731:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca090400, rc 0) 00000100:00100000:3.0:1786400936.994818:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+7:11347:x1873176850138112:12345-192.168.204.8@tcp:101:bash.0 Request processed in 5855us (6059us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400936.994828:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 49 00000100:00100000:1.0:1786400936.995052:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850138240 00000100:00100000:1.0:1786400936.995060:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850138240 00010000:00010000:1.0:1786400936.995128:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000d15db91/0x5ccaaf4f3cb1e28d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd41 expref: 7 pid: 6593 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400936.995166:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 62 00000100:00100000:1.0:1786400936.995175:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd61c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096c63d9-38b8-441b-8c71-343db25fe88a+7:2364:x1873176850138240:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400936.995188:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400936.995208:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000d15db91/0x5ccaaf4f3cb1e28d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd41 expref: 7 pid: 6593 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400936.995220:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000d15db91/0x5ccaaf4f3cb1e28d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd41 expref: 7 pid: 6593 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400936.995255:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d15db91/0x5ccaaf4f3cb1e28d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd41 expref: 7 pid: 6593 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400936.995271:0:5773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786400936.995275:0:5773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786400936.995283:0:5773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000209afceb/0x5ccaaf4f3cb1e294 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd48 expref: 6 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400936.995293:0:5773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000209afceb/0x5ccaaf4f3cb1e294 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd48 expref: 6 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400936.995329:0:5773:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000209afceb/0x5ccaaf4f3cb1e294 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd48 expref: 6 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400936.995342:0:5773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fe9207b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5773:1873176872161920:192.168.204.8@tcp:105: 00000100:00100000:1.0:1786400936.995395:0:5773:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fee1f30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786400936.998942:0:5773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fe9207b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5773:1873176872161920:192.168.204.8@tcp:105: 00010000:00010000:1.0:1786400936.998968:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400936.999082:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd61c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096c63d9-38b8-441b-8c71-343db25fe88a+6:2364:x1873176850138240:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 3906us (4537us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400936.999132:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 62 00000100:00100000:2.0:1786400937.001963:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400937.002600:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850138496 00000100:00100000:1.0:1786400937.002611:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850138496 00000100:00100000:1.0:1786400937.002718:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 36 00000100:00100000:1.0:1786400937.002729:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+18:11347:x1873176850138496:12345-192.168.204.8@tcp:35:bash.0 00000100:00100000:1.0:1786400937.003195:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+19:11347:x1873176850138496:12345-192.168.204.8@tcp:35:bash.0 Request processed in 466us (1240us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1786400937.003204:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 36 00000100:00100000:0.0:1786400937.089638:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400937.089722:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850138752 00000100:00100000:1.0:1786400937.089732:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850138752 00000100:00100000:1.0:1786400937.089793:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 144 00000100:00100000:1.0:1786400937.089803:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdb85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+19:11357:x1873176850138752:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:1.0:1786400937.089827:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400937.089847:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e29b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bd4f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400937.089968:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1786400937.090310:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e29b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd4f expref: 21 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400937.090479:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fc5599b00) 00010000:00010000:1.0:1786400937.090482:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786400937.090560:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e29b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd4f expref: 21 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400937.090577:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138fa00, rc 0) 00000100:00100000:1.0:1786400937.090652:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdb85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+20:11357:x1873176850138752:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 850us (1023us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1786400937.090660:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 144 00000100:00100000:2.0:1786400937.095437:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400937.095542:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850139008 00000100:00100000:0.0:1786400937.095552:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850139008 00000100:00100000:0.0:1786400937.095651:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 37 00000100:00100000:0.0:1786400937.095662:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+20:11357:x1873176850139008:12345-192.168.204.8@tcp:35:lfs.0 00000100:00100000:0.0:1786400937.095960:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+21:11357:x1873176850139008:12345-192.168.204.8@tcp:35:lfs.0 Request processed in 298us (531us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1786400937.095968:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 37 00000100:00100000:2.0:1786400937.164064:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400937.164209:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850139136 00000100:00100000:3.0:1786400937.164220:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850139136 00000100:00100000:3.0:1786400937.164284:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 145 00000100:00100000:3.0:1786400937.164295:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+21:11363:x1873176850139136:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:3.0:1786400937.164320:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400937.164343:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090200/0x5ccaaf4f3cb1e2a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bd56 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.164418:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e2b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.164432:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e2b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.164444:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e2b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400937.164508:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1786400937.164512:0:5789:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1786400937.164535:0:5789:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e2b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.164562:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090200/0x5ccaaf4f3cb1e2a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd56 expref: 23 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.164580:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e2b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd56 expref: 22 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.164610:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d6fc5599e00) 00010000:00010000:3.0:1786400937.164613:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786400937.164617:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca090c00, rc 0) 00000100:00100000:3.0:1786400937.164729:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+22:11363:x1873176850139136:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 434us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400937.164737:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 145 00000100:00100000:3.0:1786400937.170394:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400937.172245:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850139392 00000100:00100000:1.0:1786400937.172260:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850139392 00000100:00100000:1.0:1786400937.172337:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 146 00000100:00100000:1.0:1786400937.172363:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+22:11363:x1873176850139392:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:1.0:1786400937.172384:0:6615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400937.172406:0:6615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e2b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bd5d expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400937.172513:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1e2be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400937.172528:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1e2be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400937.172538:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1e2be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400937.172550:0:6615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1786400937.172684:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e2b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd5d expref: 25 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400937.172702:0:6615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1e2be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd5d expref: 24 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400937.172710:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fe06cbe00) 00010000:00010000:1.0:1786400937.172713:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786400937.172718:0:6615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138ea00, rc 0) 00000100:00100000:1.0:1786400937.172989:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+24:11363:x1873176850139392:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 628us (2603us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1786400937.172998:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 146 00000100:00100000:2.0:1786400937.176957:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400937.177483:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850139520 00000100:00100000:3.0:1786400937.177494:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850139520 00000100:00100000:3.0:1786400937.177707:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 11 00000100:00100000:3.0:1786400937.177719:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd5b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096c63d9-38b8-441b-8c71-343db25fe88a+24:2365:x1873176850139520:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786400937.177742:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400937.177768:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1e2be lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd5d expref: 24 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.177788:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fe06cbe00) 00010000:00010000:3.0:1786400937.177792:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400937.177866:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd5b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096c63d9-38b8-441b-8c71-343db25fe88a+23:2365:x1873176850139520:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 149us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400937.177884:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 11 00000100:00100000:1.0:1786400937.177893:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400937.178009:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850139776 00000100:00100000:0.0:1786400937.178014:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850139776 00000100:00100000:0.0:1786400937.178056:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 147 00000100:00100000:0.0:1786400937.178064:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fe9207b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+23:11363:x1873176850139776:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:0.0:1786400937.178104:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400937.178133:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1e2cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bd64 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400937.178959:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1e2d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400937.178975:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1e2d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400937.178987:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1e2d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400937.179000:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1786400937.179669:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1e2cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd64 expref: 26 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400937.179692:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1e2d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd64 expref: 25 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400937.179701:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fe06cbe00) 00010000:00010000:0.0:1786400937.179704:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1786400937.179707:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5aba00, rc 0) 00000100:00100000:0.0:1786400937.179772:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fe9207b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+25:11363:x1873176850139776:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 1708us (1877us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1786400937.179782:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 147 00000100:00100000:1.0:1786400937.187700:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400937.188020:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850139904 00000100:00100000:2.0:1786400937.188031:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850139904 00000100:00100000:2.0:1786400937.188117:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 50 00000100:00100000:2.0:1786400937.188128:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fe9205f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+6:2363:x1873176850139904:12345-192.168.204.8@tcp:1:lfs.0 00010000:00010000:2.0:1786400937.188186:0:6593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d0f1cfb/0x5ccaaf4f3cb1e2e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.188207:0:6593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000209afceb/0x5ccaaf4f3cb1e294 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd48 expref: 6 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.188216:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400937.188220:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786400937.188225:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d0f1cfb/0x5ccaaf4f3cb1e2e1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.188264:0:6593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000209afceb/0x5ccaaf4f3cb1e294 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd48 expref: 6 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.188280:0:6593:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000209afceb/0x5ccaaf4f3cb1e294 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd48 expref: 6 pid: 6590 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400937.188306:0:6593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd5bad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6593:1873176872162048:192.168.204.8@tcp:104: 00000100:00100000:2.0:1786400937.188424:0:6593:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec5984c00 going to sleep for 11 seconds 00000100:00100000:0.0:1786400937.193234:0:6593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd5bad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6593:1873176872162048:192.168.204.8@tcp:104: 00010000:00010000:0.0:1786400937.193271:0:6593:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006d0f1cfb/0x5ccaaf4f3cb1e2e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400937.193383:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400937.193460:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850140032 00000100:00100000:3.0:1786400937.193470:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850140032 00002000:00100000:3.0:1786400937.193515:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9d6ffd5bad80 x1873176850140032/t0(0) o4->096c63d9-38b8-441b-8c71-343db25fe88a@192.168.204.8@tcp:733/0 lens 504/0 e 0 to 0 dl 1786400948 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786400937.193526:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ffd5bad80 with x1873176850140032 ext(0->12) 00010000:00010000:3.0:1786400937.193541:0:6596:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000209afceb/0x5ccaaf4f3cb1e294 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd48 expref: 7 pid: 6590 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.193554:0:6596:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000209afceb/0x5ccaaf4f3cb1e294 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd48 expref: 7 pid: 6590 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786400937.193563:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9d6ffd5bad80 00000100:00100000:3.0:1786400937.193634:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2 00000100:00100000:3.0:1786400937.193644:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd5bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:096c63d9-38b8-441b-8c71-343db25fe88a+7:2365:x1873176850140032:12345-192.168.204.8@tcp:4:lfs.0 00000100:00100000:2.0:1786400937.194815:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd5bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:096c63d9-38b8-441b-8c71-343db25fe88a+9:2365:x1873176850140032:12345-192.168.204.8@tcp:4:lfs.0 Request processed in 1166us (1427us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1786400937.194826:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2 00002000:00100000:2.0:1786400937.194836:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9d6ffd5bad80 x1873176850140032/t4294967305(0) o4->096c63d9-38b8-441b-8c71-343db25fe88a@192.168.204.8@tcp:733/0 lens 504/448 e 0 to 0 dl 1786400948 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786400937.194846:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ffd5bad80 with x1873176850140032 ext(0->12) 00010000:00010000:2.0:1786400937.194853:0:6596:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000209afceb/0x5ccaaf4f3cb1e294 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd48 expref: 9 pid: 6590 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.194868:0:6596:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000209afceb/0x5ccaaf4f3cb1e294 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd48 expref: 9 pid: 6590 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786400937.194875:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9d6ffd5bad80 00000100:00100000:0.0:1786400937.202891:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400937.203337:0:8369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850140160 00000100:00100000:3.0:1786400937.203349:0:8369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850140160 00010000:00010000:3.0:1786400937.203392:0:8369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000209afceb/0x5ccaaf4f3cb1e294 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd48 expref: 9 pid: 6590 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400937.203439:0:8369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 63 00000100:00100000:3.0:1786400937.203449:0:8369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdb87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+9:2362:x1873176850140160:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786400937.203464:0:8369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1786400937.203482:0:8369:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1786400937.203486:0:8369:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1786400935 00002000:00010000:3.0:1786400937.203488:0:8369:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1786400935 00002000:00010000:3.0:1786400937.203490:0:8369:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1786400935 00010000:00010000:3.0:1786400937.203497:0:8369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000209afceb/0x5ccaaf4f3cb1e294 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd48 expref: 9 pid: 6590 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.204850:0:8369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000209afceb/0x5ccaaf4f3cb1e294 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd48 expref: 9 pid: 6590 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.205124:0:8369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000209afceb/0x5ccaaf4f3cb1e294 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd48 expref: 9 pid: 6590 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.205144:0:8369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786400937.205149:0:8369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786400937.205180:0:8369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006d0f1cfb/0x5ccaaf4f3cb1e2e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.205192:0:8369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d0f1cfb/0x5ccaaf4f3cb1e2e1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.206844:0:8369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400937.206922:0:8369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdb87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+8:2362:x1873176850140160:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 3468us (4035us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400937.206934:0:8369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 63 00010000:00010000:1.0:1786400937.207002:0:6593:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006d0f1cfb/0x5ccaaf4f3cb1e2e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400937.207014:0:6593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d0f1cfb/0x5ccaaf4f3cb1e2e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400937.207063:0:6593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d0f1cfb/0x5ccaaf4f3cb1e2e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400937.207072:0:6593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d0f1cfb/0x5ccaaf4f3cb1e2e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400937.207080:0:6593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d0f1cfb/0x5ccaaf4f3cb1e2e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400937.207113:0:6593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1bb200 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:1.0:1786400937.207118:0:6593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d0f1cfb/0x5ccaaf4f3cb1e2e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400937.207128:0:6593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d0f1cfb/0x5ccaaf4f3cb1e2e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400937.207144:0:6593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d0f1cfb/0x5ccaaf4f3cb1e2e1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400937.207163:0:6593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d0f1cfb/0x5ccaaf4f3cb1e2e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400937.207296:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fe9205f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+7:2363:x1873176850139904:12345-192.168.204.8@tcp:1:lfs.0 Request processed in 19170us (19608us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400937.207305:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 50 00000100:00100000:1.0:1786400937.214718:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400937.214813:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850140416 00000100:00100000:2.0:1786400937.214824:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850140416 00000100:00100000:2.0:1786400937.214987:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 38 00000100:00100000:2.0:1786400937.214999:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6d7f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+25:11363:x1873176850140416:12345-192.168.204.8@tcp:35:lfs.0 00000004:00010000:2.0:1786400937.215078:0:5792:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1e2d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd64 expref: 25 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786400937.215422:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1786400937.215469:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1786400937.215997:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1786400937.216061:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1baa00/0x5ccaaf4f3cb1e2e8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.216078:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e27f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd3a expref: 29 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.216113:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1baa00/0x5ccaaf4f3cb1e2e8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.216181:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e27f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd3a expref: 29 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.216196:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e27f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd3a expref: 29 pid: 5790 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400937.216212:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f65180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5792:1873176872162176:192.168.204.8@tcp:104: 00000100:00100000:2.0:1786400937.216752:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec5984cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400937.219049:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f65180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5792:1873176872162176:192.168.204.8@tcp:104: 00010000:00010000:2.0:1786400937.219078:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1baa00/0x5ccaaf4f3cb1e2e8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400937.220016:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400937.220116:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850140544 00000100:00100000:2.0:1786400937.220140:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850140544 00010000:00010000:2.0:1786400937.220190:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e27f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd3a expref: 30 pid: 5790 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400937.220231:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 64 00000100:00100000:2.0:1786400937.220241:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc458a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096c63d9-38b8-441b-8c71-343db25fe88a+30:2364:x1873176850140544:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786400937.220258:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400937.220265:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e27f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd3a expref: 30 pid: 5790 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.220277:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e27f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd3a expref: 30 pid: 5790 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.220297:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e27f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd3a expref: 30 pid: 5790 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.220314:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fe06cbe00) 00010000:00010000:2.0:1786400937.220318:0:5774:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1baa00/0x5ccaaf4f3cb1e2e8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.220327:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1baa00/0x5ccaaf4f3cb1e2e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.220335:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1baa00/0x5ccaaf4f3cb1e2e8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.220406:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400937.220470:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc458a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096c63d9-38b8-441b-8c71-343db25fe88a+29:2364:x1873176850140544:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 230us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400937.220487:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 64 00010000:00010000:1.0:1786400937.220949:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1baa00/0x5ccaaf4f3cb1e2e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400937.220958:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1baa00/0x5ccaaf4f3cb1e2e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786400937.221240:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1786400937.221744:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1786400937.221858:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc4908380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5792:1873176872162304:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1786400937.221987:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400937.222023:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fee1f3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1786400937.222236:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872162304 00000100:00100000:2.0:1786400937.222244:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872162304 00000100:00100000:2.0:1786400937.222306:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1786400937.222316:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5792:x1873176872162304:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1786400937.222407:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5792:x1873176872162304:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 92us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400937.222414:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1786400937.222773:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc4908380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5792:1873176872162304:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1786400937.223331:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1786400937.223394:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdb85180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5792:1873176872162432:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1786400937.223434:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400937.223454:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff6ec9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400937.223683:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872162432 00000100:00100000:2.0:1786400937.223689:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872162432 00000100:00100000:2.0:1786400937.223720:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1786400937.223727:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdb85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5792:x1873176872162432:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1786400937.223885:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdb85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5792:x1873176872162432:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 157us (450us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1786400937.223892:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1786400937.224064:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786400937.224350:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdb85180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5792:1873176872162432:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1786400937.224409:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1786400937.224451:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1baa00/0x5ccaaf4f3cb1e2e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400937.224463:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1baa00/0x5ccaaf4f3cb1e2e8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400937.224471:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1baa00/0x5ccaaf4f3cb1e2e8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400937.224478:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1baa00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400937.224482:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1baa00/0x5ccaaf4f3cb1e2e8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400937.224491:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1baa00/0x5ccaaf4f3cb1e2e8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400937.224507:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fe06cbe00) 00010000:00010000:0.0:1786400937.224510:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1786400937.224515:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1baa00/0x5ccaaf4f3cb1e2e8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400937.224532:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1baa00/0x5ccaaf4f3cb1e2e8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786400937.224717:0:5792:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1786400937.224831:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1786400937.224843:0:5792:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 389625755967ns, next at 390625754361ns, rc = 0 00000001:00080000:0.0:1786400937.224849:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1786400937.224952:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fe06cbe00) 00010000:00010000:0.0:1786400937.224956:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1786400937.224963:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1e2d3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd64 expref: 33 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400937.225267:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6d7f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+32:11363:x1873176850140416:12345-192.168.204.8@tcp:35:lfs.0 Request processed in 10269us (10558us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1786400937.225276:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 38 00000020:00080000:0.0:1786400937.225281:0:5792:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1786400937.229556:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400937.229655:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850140672 00000100:00100000:3.0:1786400937.229666:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850140672 00000100:00100000:3.0:1786400937.229784:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 148 00000100:00100000:3.0:1786400937.229795:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+32:11363:x1873176850140672:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:3.0:1786400937.229821:0:6615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400937.229845:0:6615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090400/0x5ccaaf4f3cb1e2ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bd6b expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.229983:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090400/0x5ccaaf4f3cb1e2ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd6b expref: 33 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.230000:0:6615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090400/0x5ccaaf4f3cb1e2ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd6b expref: 33 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.230021:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fc5599800) 00010000:00010000:3.0:1786400937.230038:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1786400937.230054:0:6615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca090400, rc 0) 00000100:00100000:3.0:1786400937.230255:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+33:11363:x1873176850140672:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 461us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400937.230263:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 148 00000100:00100000:2.0:1786400937.236457:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400937.236683:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850140928 00000100:00100000:0.0:1786400937.236692:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850140928 00000100:00100000:0.0:1786400937.236812:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 39 00000100:00100000:0.0:1786400937.236823:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+33:11363:x1873176850140928:12345-192.168.204.8@tcp:35:lfs.0 00000100:00100000:0.0:1786400937.237247:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+34:11363:x1873176850140928:12345-192.168.204.8@tcp:35:lfs.0 Request processed in 425us (800us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1786400937.237257:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 39 00000100:00100000:0.0:1786400937.326081:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400937.326532:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850141184 00000100:00100000:1.0:1786400937.326543:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850141184 00000100:00100000:1.0:1786400937.326645:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 149 00000100:00100000:1.0:1786400937.326656:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdb84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+34:11373:x1873176850141184:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:1.0:1786400937.326683:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400937.326705:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e2f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bd72 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400937.326840:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1786400937.327006:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e2f6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd72 expref: 36 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400937.327022:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fc5599b00) 00010000:00010000:1.0:1786400937.327025:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786400937.327030:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e2f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd72 expref: 36 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400937.327047:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138f800, rc 0) 00000100:00100000:1.0:1786400937.327510:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdb84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+35:11373:x1873176850141184:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 853us (1499us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1786400937.327519:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 149 00000100:00100000:3.0:1786400937.332348:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400937.332430:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850141312 00000100:00100000:2.0:1786400937.332440:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850141312 00000100:00100000:2.0:1786400937.332518:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 150 00000100:00100000:2.0:1786400937.332528:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+35:11373:x1873176850141312:12345-192.168.204.8@tcp:34:lfs.0 00010000:00010000:2.0:1786400937.332613:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e304 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.332630:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e304 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.332641:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e304 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.332670:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e30b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.332678:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e30b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.332685:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e30b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.332786:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e312 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.332796:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e312 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.332803:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e312 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786400937.332845:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e312 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.332857:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e304 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.332863:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e304 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.332869:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e304 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.332876:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1ba600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400937.332880:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e304 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.332894:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e304 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.332907:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d6fc5599e00) 00010000:00010000:2.0:1786400937.332911:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400937.332916:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e304 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.332922:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e304 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.332937:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e30b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.332943:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e30b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.332949:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e30b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.332954:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1ba800 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400937.332957:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e30b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.332963:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e30b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.332970:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d6fd022e100) 00010000:00010000:2.0:1786400937.332972:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400937.332975:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e30b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.332989:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e30b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.333005:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e312 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.333011:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e312 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.333017:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e312 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.333023:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1bba00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400937.333026:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e312 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.333031:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e312 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.333038:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fc5599800) 00010000:00010000:2.0:1786400937.333040:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400937.333043:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e312 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.333048:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e312 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400937.333207:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+35:11373:x1873176850141312:12345-192.168.204.8@tcp:34:lfs.0 Request processed in 680us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400937.333216:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 150 00000100:00100000:3.0:1786400937.336503:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400937.336660:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850141568 00000100:00100000:1.0:1786400937.336670:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850141568 00000100:00100000:1.0:1786400937.336785:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 40 00000100:00100000:1.0:1786400937.336796:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+35:11373:x1873176850141568:12345-192.168.204.8@tcp:35:lfs.0 00000100:00100000:1.0:1786400937.337052:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+36:11373:x1873176850141568:12345-192.168.204.8@tcp:35:lfs.0 Request processed in 258us (560us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1786400937.337060:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 40 00000100:00100000:0.0:1786400937.394839:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400937.394962:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850141824 00000100:00100000:3.0:1786400937.395242:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850141824 00000100:00100000:3.0:1786400937.395346:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 151 00000100:00100000:3.0:1786400937.395360:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdb85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+36:11376:x1873176850141824:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:3.0:1786400937.395393:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400937.395423:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090200/0x5ccaaf4f3cb1e319 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bd79 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.396289:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e320 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.396312:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e320 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.396327:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e320 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.396344:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e327 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.396494:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e327 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.396502:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e327 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.396719:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091c00/0x5ccaaf4f3cb1e32e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.396729:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091c00/0x5ccaaf4f3cb1e32e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.396736:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091c00/0x5ccaaf4f3cb1e32e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400937.396748:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1786400937.397781:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e320 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.397798:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e320 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.397806:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e320 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.397813:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca090e00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786400937.397818:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e320 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.397827:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e320 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.397844:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d6fc5599e00) 00010000:00010000:3.0:1786400937.397847:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400937.397853:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e320 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.397937:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e320 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.397955:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e327 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.397961:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e327 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.397967:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e327 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.397973:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca091800 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786400937.397976:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e327 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.399206:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e327 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.399227:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d6fc5599200) 00010000:00010000:3.0:1786400937.399231:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400937.399236:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e327 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.399244:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e327 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.399337:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090200/0x5ccaaf4f3cb1e319 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd79 expref: 39 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.399356:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091c00/0x5ccaaf4f3cb1e32e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd79 expref: 38 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.399380:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fc5599800) 00010000:00010000:3.0:1786400937.399383:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786400937.399386:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca091c00, rc 0) 00000100:00100000:3.0:1786400937.399489:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdb85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+38:11376:x1873176850141824:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 4130us (4658us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1786400937.399500:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 151 00000100:00100000:3.0:1786400937.404183:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400937.404379:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850141952 00000100:00100000:2.0:1786400937.404393:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850141952 00000100:00100000:2.0:1786400937.404467:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 152 00000100:00100000:2.0:1786400937.404480:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+38:11376:x1873176850141952:12345-192.168.204.8@tcp:54:lfs.0 00010000:00010000:2.0:1786400937.404576:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e33c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.404598:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e33c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.404614:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e33c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.404652:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e33c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.404661:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e33c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.404669:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e33c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.404676:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1ba800 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400937.404682:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e33c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.404690:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e33c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.404706:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fc5599800) 00010000:00010000:2.0:1786400937.404710:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786400937.404716:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e33c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.404743:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e33c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400937.404845:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+38:11376:x1873176850141952:12345-192.168.204.8@tcp:54:lfs.0 Request processed in 367us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400937.404855:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 152 00000100:00100000:2.0:1786400937.409002:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400937.409504:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850142208 00000100:00100000:1.0:1786400937.409518:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850142208 00000100:00100000:1.0:1786400937.409591:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 41 00000100:00100000:1.0:1786400937.409603:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+38:11376:x1873176850142208:12345-192.168.204.8@tcp:35:lfs.0 00000100:00100000:1.0:1786400937.411945:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+39:11376:x1873176850142208:12345-192.168.204.8@tcp:35:lfs.0 Request processed in 2324us (2936us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1786400937.411967:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 41 00000001:00080000:3.0:1786400937.784959:0:11930:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967432 is committed 00000004:00080000:3.0:1786400937.784982:0:11930:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1786400937.785007:0:11930:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d6ff6ec99c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1786400937.785013:0:11930:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d6fc923ac00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d6ff6ec9900 00000020:00080000:3.0:1786400937.785017:0:11930:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d6fc923a500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d6ffd665400 00000001:00080000:3.0:1786400937.785036:0:11930:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967436 is committed 00000020:00080000:3.0:1786400937.785150:0:5822:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1786400937.785405:0:5822:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1786400937.785763:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdb87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872162560:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1786400937.785928:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400937.786066:0:11770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872162560 00000100:00100000:0.0:1786400937.786123:0:11770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872162560 00000100:00100000:0.0:1786400937.786195:0:11770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1786400937.786206:0:11770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1873176872162560:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1786400937.786244:0:11770:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1786400937.786287:0:11770:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a7a50a7, atime: 0x6a7a50a7, ctime: 0x6a7a50a7, blocks: 0x1 00010000:00010000:0.0:1786400937.786299:0:11770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000caadea99/0x5ccaaf4f3cb1e343 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400937.786320:0:11770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=390s v=(0 0) 00010000:00010000:0.0:1786400937.786326:0:11770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786400937.786334:0:11770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000caadea99/0x5ccaaf4f3cb1e343 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400937.786355:0:11770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000caadea99/0x5ccaaf4f3cb1e343 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400937.786367:0:11770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000caadea99/0x5ccaaf4f3cb1e343 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400937.786375:0:11770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000caadea99/0x5ccaaf4f3cb1e343 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400937.786393:0:11770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786400937.787319:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786400937.787333:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000caadea99/0x5ccaaf4f3cb1e343 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.787347:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5ab800 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:3.0:1786400937.787353:0:5776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000caadea99/0x5ccaaf4f3cb1e343 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.787366:0:5776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000caadea99/0x5ccaaf4f3cb1e343 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.787408:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000caadea99/0x5ccaaf4f3cb1e343 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.787416:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000caadea99/0x5ccaaf4f3cb1e343 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.787445:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400937.787447:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400937.787450:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400937.787499:0:11770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1873176872162560:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1291us (1632us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1786400937.787509:0:11770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000004:00080000:2.0:1786400937.787704:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d6ffdb87800/2, rc 0, transno 4294967307 00000100:00100000:2.0:1786400937.787712:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdb87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872162560:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1786400937.800055:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400937.803043:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850142464 00000100:00100000:1.0:1786400937.803067:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850142464 00000100:00100000:1.0:1786400937.803192:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 153 00000100:00100000:1.0:1786400937.803205:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdb84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+17:11407:x1873176850142464:12345-192.168.204.8@tcp:101:cat.0 00010000:00010000:1.0:1786400937.803244:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400937.803272:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e34a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bd80 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400937.803411:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e351 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400937.803428:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e351 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400937.803445:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e351 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400937.803458:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1786400937.803758:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e34a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd80 expref: 20 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400937.803782:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e351 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd80 expref: 19 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400937.803792:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fc5599800) 00010000:00010000:1.0:1786400937.803795:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786400937.803799:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138f200, rc 0) 00000100:00100000:1.0:1786400937.804052:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdb84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+19:11407:x1873176850142464:12345-192.168.204.8@tcp:101:cat.0 Request processed in 848us (4010us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1786400937.804083:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 153 00000100:00100000:2.0:1786400937.818387:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400937.818527:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850142592 00000100:00100000:1.0:1786400937.818541:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850142592 00000100:00100000:1.0:1786400937.818668:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 12 00000100:00100000:1.0:1786400937.818680:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096c63d9-38b8-441b-8c71-343db25fe88a+19:2363:x1873176850142592:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400937.818701:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400937.818736:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e351 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd80 expref: 19 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400937.818763:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fc5599800) 00010000:00010000:1.0:1786400937.818770:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400937.818857:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096c63d9-38b8-441b-8c71-343db25fe88a+18:2363:x1873176850142592:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 178us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400937.818866:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 12 00000100:00100000:0.0:1786400937.819187:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400937.819827:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850142848 00000100:00100000:0.0:1786400937.819836:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850142848 00000100:00100000:0.0:1786400937.819885:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 42 00000100:00100000:0.0:1786400937.819895:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdb84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+18:11407:x1873176850142848:12345-192.168.204.8@tcp:35:cat.0 00000100:00100000:0.0:1786400937.820252:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdb84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+19:11407:x1873176850142848:12345-192.168.204.8@tcp:35:cat.0 Request processed in 357us (1064us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1786400937.820261:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 42 00000100:00100000:0.0:1786400937.891772:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400937.892247:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850143104 00000100:00100000:2.0:1786400937.892261:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850143104 00000100:00100000:2.0:1786400937.892368:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 154 00000100:00100000:2.0:1786400937.892392:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdb86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+19:11413:x1873176850143104:12345-192.168.204.8@tcp:101:dd.0 00010000:00010000:2.0:1786400937.892424:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400937.892428:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1786400937.892463:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e2b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd56 expref: 19 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.892489:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d6fc5599e00) 00010000:00010000:2.0:1786400937.892495:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786400937.892513:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e35f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bd87 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.892664:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e366 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.892683:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091c00/0x5ccaaf4f3cb1e32e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd79 expref: 19 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.892692:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e366 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.892734:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091c00/0x5ccaaf4f3cb1e32e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd79 expref: 19 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.892749:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091c00/0x5ccaaf4f3cb1e32e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd79 expref: 19 pid: 5789 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400937.892765:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f67800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5788:1873176872162688:192.168.204.8@tcp:104: 00000100:00100000:2.0:1786400937.892885:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec5984d80 going to sleep for 11 seconds 00000100:00100000:2.0:1786400937.897070:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f67800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5788:1873176872162688:192.168.204.8@tcp:104: 00000100:00100000:0.0:1786400937.897243:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400937.897608:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850143232 00000100:00100000:1.0:1786400937.897634:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850143232 00010000:00010000:1.0:1786400937.897689:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091c00/0x5ccaaf4f3cb1e32e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd79 expref: 20 pid: 5789 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400937.897732:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 65 00000100:00100000:1.0:1786400937.897743:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdb85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096c63d9-38b8-441b-8c71-343db25fe88a+20:2364:x1873176850143232:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400937.897760:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400937.897767:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091c00/0x5ccaaf4f3cb1e32e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd79 expref: 20 pid: 5789 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400937.897783:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091c00/0x5ccaaf4f3cb1e32e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd79 expref: 20 pid: 5789 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.898378:0:5788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e366 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400937.898396:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091c00/0x5ccaaf4f3cb1e32e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd79 expref: 20 pid: 5789 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400937.898420:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fc5599800) 00010000:00010000:1.0:1786400937.898426:0:5774:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e366 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400937.898437:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e366 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400937.898446:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e366 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400937.898482:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786400937.898561:0:5788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e366 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400937.898564:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdb85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096c63d9-38b8-441b-8c71-343db25fe88a+19:2364:x1873176850143232:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 820us (1320us total) trans 0 rc 0/0 00010000:00010000:2.0:1786400937.898579:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e366 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400937.898581:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 65 00000004:00200000:2.0:1786400937.898608:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1786400937.899265:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e35f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd87 expref: 20 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.899287:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e366 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd87 expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400937.899296:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fc5599800) 00010000:00010000:2.0:1786400937.899300:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1786400937.899302:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fee1ba600, rc 0) 00000100:00100000:2.0:1786400937.899621:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdb86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+19:11413:x1873176850143104:12345-192.168.204.8@tcp:101:dd.0 Request processed in 6969us (7590us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1786400937.899633:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 154 00010000:00010000:2.0:1786400937.903421:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400937.905978:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400937.907215:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850143488 00000100:00100000:1.0:1786400937.907232:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850143488 00000100:00100000:1.0:1786400937.908312:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 155 00000100:00100000:1.0:1786400937.908335:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+19:11413:x1873176850143488:12345-192.168.204.8@tcp:36:dd.0 00010000:00010000:1.0:1786400937.908737:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e374 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400937.908759:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e374 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400937.908774:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e374 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786400937.908939:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1786400937.908969:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c6d7fda1 reply state 00000000a86f74ea transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e374 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400937.908980:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786400937.911105:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+22:11413:x1873176850143488:12345-192.168.204.8@tcp:36:dd.0 Request processed in 2746us (5107us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1786400937.911120:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 155 00000020:00080000:1.0:1786400937.911132:0:5790:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1786400937.917999:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e374 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.918023:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e374 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.918032:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e374 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.918038:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138f200 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786400937.918044:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e374 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.918053:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e374 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.918077:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fc5599800) 00010000:00010000:3.0:1786400937.918081:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400937.918179:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e374 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400937.918187:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e374 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400938.195971:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400938.196127:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850143616 00000100:00100000:1.0:1786400938.196338:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850143616 00000100:00100000:1.0:1786400938.196436:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 156 00000100:00100000:1.0:1786400938.196451:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+21:11427:x1873176850143616:12345-192.168.204.8@tcp:101:stat.0 00010000:00010000:1.0:1786400938.196485:0:6615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400938.196515:0:6615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e37b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bd8e expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400938.196608:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e382 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1786400938.197253:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786400938.197347:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e382 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400938.197363:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e382 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400938.197386:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e389 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400938.197416:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e389 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400938.197423:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e389 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400938.198074:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e390 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400938.198122:0:6615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e366 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd87 expref: 22 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400938.198149:0:6615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e390 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400938.198200:0:6615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e366 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd87 expref: 22 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400938.198218:0:6615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e366 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd87 expref: 22 pid: 5788 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400938.198236:0:6615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc4908380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6615:1873176872162816:192.168.204.8@tcp:104: 00000100:00100000:1.0:1786400938.198878:0:6615:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fee1f30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400938.208434:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400938.208562:0:6615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc4908380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6615:1873176872162816:192.168.204.8@tcp:104: 00010000:00010000:1.0:1786400938.208597:0:6615:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e390 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400938.208699:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850143872 00000100:00100000:2.0:1786400938.208710:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850143872 00000100:00100000:2.0:1786400938.208788:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 43 00000100:00100000:2.0:1786400938.208799:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdb86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+23:5578:x1873176850143872:12345-192.168.204.8@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1786400938.209287:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdb86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+24:5578:x1873176850143872:12345-192.168.204.8@tcp:35:ldlm_bl.0 Request processed in 488us (868us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1786400938.209298:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 43 00000100:00100000:0.0:1786400938.213074:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400938.213235:0:8369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850144000 00000100:00100000:2.0:1786400938.213249:0:8369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850144000 00010000:00010000:2.0:1786400938.213300:0:8369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e366 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd87 expref: 24 pid: 5788 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400938.213402:0:8369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 66 00000100:00100000:2.0:1786400938.213414:0:8369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdb86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+24:2365:x1873176850144000:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786400938.213458:0:8369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400938.213467:0:8369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e366 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd87 expref: 24 pid: 5788 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.213484:0:8369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e366 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd87 expref: 24 pid: 5788 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.213513:0:8369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e366 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd87 expref: 24 pid: 5788 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.213536:0:8369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fc5599800) 00010000:00010000:2.0:1786400938.213543:0:8369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e390 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.213553:0:8369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e390 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.213562:0:8369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e390 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.213786:0:8369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400938.213861:0:8369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdb86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+23:2365:x1873176850144000:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 448us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400938.213870:0:8369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 66 00010000:00010000:3.0:1786400938.214863:0:6615:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e390 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400938.214879:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e390 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400938.214942:0:6615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1786400938.214948:0:6615:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786400938.214982:0:6615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e390 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400938.215000:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e390 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400938.215012:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e382 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400938.215019:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e382 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400938.215027:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e382 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400938.215033:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138f200 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786400938.215039:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e382 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400938.215065:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e382 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400938.215082:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d6fc5599e00) 00010000:00010000:3.0:1786400938.215120:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400938.215126:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e382 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400938.215143:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e382 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400938.215332:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e389 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400938.215339:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e389 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400938.215346:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e389 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400938.215351:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138f400 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786400938.215354:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e389 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400938.215361:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e389 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400938.215370:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d6fe06cb200) 00010000:00010000:3.0:1786400938.215373:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400938.215376:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e389 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400938.215394:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e389 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400938.215447:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e37b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd8e expref: 23 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400938.215463:0:6615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e390 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd8e expref: 22 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400938.215471:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fc5599800) 00010000:00010000:3.0:1786400938.215474:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786400938.215477:0:6615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138fa00, rc 0) 00000100:00100000:3.0:1786400938.216333:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+22:11427:x1873176850143616:12345-192.168.204.8@tcp:101:stat.0 Request processed in 19879us (20369us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400938.216347:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 156 00000100:00100000:0.0:1786400938.345726:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400938.346429:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850144256 00000100:00100000:3.0:1786400938.346444:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850144256 00000100:00100000:3.0:1786400938.346532:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 157 00000100:00100000:3.0:1786400938.346544:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdb84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+22:11433:x1873176850144256:12345-192.168.204.8@tcp:36:truncate.0 00010000:00010000:3.0:1786400938.346625:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400938.346661:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e390 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd8e expref: 22 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400938.346688:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fc5599800) 00010000:00010000:3.0:1786400938.346694:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786400938.348609:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090200/0x5ccaaf4f3cb1e397 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400938.348655:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090200/0x5ccaaf4f3cb1e397 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400938.348671:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090200/0x5ccaaf4f3cb1e397 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1786400938.348743:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1786400938.351244:0:5789:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002e756395 reply state 000000004eeaf242 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090200/0x5ccaaf4f3cb1e397 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400938.351272:0:5789:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786400938.351863:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdb84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+24:11433:x1873176850144256:12345-192.168.204.8@tcp:36:truncate.0 Request processed in 5304us (6135us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1786400938.351875:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 157 00000020:00080000:3.0:1786400938.351883:0:5789:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1786400938.361069:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090200/0x5ccaaf4f3cb1e397 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.361138:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090200/0x5ccaaf4f3cb1e397 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.361185:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090200/0x5ccaaf4f3cb1e397 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.361192:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca090200 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400938.361198:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090200/0x5ccaaf4f3cb1e397 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.361207:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090200/0x5ccaaf4f3cb1e397 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.361231:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fc5599800) 00010000:00010000:2.0:1786400938.361235:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400938.361241:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090200/0x5ccaaf4f3cb1e397 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.361248:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090200/0x5ccaaf4f3cb1e397 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400938.668274:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400938.668423:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850144384 00000100:00100000:2.0:1786400938.668437:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850144384 00000100:00100000:2.0:1786400938.668872:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 158 00000100:00100000:2.0:1786400938.668884:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdb84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+23:11447:x1873176850144384:12345-192.168.204.8@tcp:101:stat.0 00010000:00010000:2.0:1786400938.668918:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400938.669180:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e39e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bd95 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.669273:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e3a5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.669291:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e3a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.669327:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e3a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.669347:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e3ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.669355:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e3ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.669362:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e3ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.671559:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb000/0x5ccaaf4f3cb1e3b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.671589:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb000/0x5ccaaf4f3cb1e3b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.671769:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb000/0x5ccaaf4f3cb1e3b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400938.671838:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1786400938.671844:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786400938.671870:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb000/0x5ccaaf4f3cb1e3b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.671884:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb000/0x5ccaaf4f3cb1e3b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.671894:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e3a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.671914:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e3a5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.671922:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e3a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.671928:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1ba800 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400938.672186:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e3a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.672197:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e3a5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.672212:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d6fc5599e00) 00010000:00010000:2.0:1786400938.672215:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400938.672220:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e3a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.672227:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e3a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.672243:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e3ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.672250:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e3ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.672257:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e3ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.672261:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1bbe00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400938.672273:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e3ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.672279:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e3ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.672289:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d6fd022e100) 00010000:00010000:2.0:1786400938.672292:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400938.672295:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e3ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.672300:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e3ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.672352:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e39e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd95 expref: 25 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.672367:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb000/0x5ccaaf4f3cb1e3b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd95 expref: 24 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.672375:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fc5599800) 00010000:00010000:2.0:1786400938.672671:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786400938.672675:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fee1bb000, rc 0) 00000100:00100000:2.0:1786400938.673324:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdb84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+24:11447:x1873176850144384:12345-192.168.204.8@tcp:101:stat.0 Request processed in 4436us (5382us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400938.673336:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 158 00000100:00100000:1.0:1786400938.809988:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400938.810197:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850144640 00000100:00100000:3.0:1786400938.810211:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850144640 00000100:00100000:3.0:1786400938.810340:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 159 00000100:00100000:3.0:1786400938.810353:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+24:11457:x1873176850144640:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:3.0:1786400938.810380:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400938.810406:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e3ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bd9c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400938.810744:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1786400938.810944:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e3ba lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd9c expref: 26 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400938.810962:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fc5599b00) 00010000:00010000:3.0:1786400938.810973:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786400938.810980:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e3ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd9c expref: 26 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400938.810999:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca091800, rc 0) 00000100:00100000:3.0:1786400938.811953:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+25:11457:x1873176850144640:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 1594us (1971us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1786400938.811967:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 159 00000100:00100000:0.0:1786400938.821293:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400938.821848:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850144896 00000100:00100000:2.0:1786400938.821861:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850144896 00000100:00100000:2.0:1786400938.822355:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 44 00000100:00100000:2.0:1786400938.822371:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6d7dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+25:11457:x1873176850144896:12345-192.168.204.8@tcp:35:lfs.0 00000100:00100000:2.0:1786400938.824142:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6d7dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+26:11457:x1873176850144896:12345-192.168.204.8@tcp:35:lfs.0 Request processed in 1753us (2842us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1786400938.824161:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 44 00010000:00010000:3.0:1786400938.926387:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400938.957365:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400938.957494:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850145152 00000100:00100000:3.0:1786400938.957508:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850145152 00000100:00100000:3.0:1786400938.957592:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 160 00000100:00100000:3.0:1786400938.957604:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc34c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+26:11463:x1873176850145152:12345-192.168.204.8@tcp:101:bash.0 00010000:00010000:3.0:1786400938.957639:0:6615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400938.957666:0:6615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e3c8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bda3 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400938.957806:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e3cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400938.957825:0:6615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb000/0x5ccaaf4f3cb1e3b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd95 expref: 27 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400938.957836:0:6615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e3cf lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400938.957897:0:6615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb000/0x5ccaaf4f3cb1e3b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd95 expref: 27 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400938.957936:0:6615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb000/0x5ccaaf4f3cb1e3b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd95 expref: 27 pid: 5788 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400938.957963:0:6615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc6080380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6615:1873176872162944:192.168.204.8@tcp:104: 00000100:00100000:3.0:1786400938.958079:0:6615:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d7000f21780 going to sleep for 11 seconds 00000100:00100000:1.0:1786400938.967163:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400938.968030:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850145280 00000100:00100000:2.0:1786400938.968046:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850145280 00010000:00010000:2.0:1786400938.968174:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb000/0x5ccaaf4f3cb1e3b3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd95 expref: 28 pid: 5788 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400938.968229:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 67 00000100:00100000:2.0:1786400938.968242:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc34c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096c63d9-38b8-441b-8c71-343db25fe88a+28:2365:x1873176850145280:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786400938.968263:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400938.968273:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb000/0x5ccaaf4f3cb1e3b3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd95 expref: 28 pid: 5788 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.968289:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb000/0x5ccaaf4f3cb1e3b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd95 expref: 28 pid: 5788 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.968320:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fc5599800) 00010000:00010000:2.0:1786400938.968326:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e3cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.968339:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e3cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.968348:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e3cf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400938.968373:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400938.968473:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc34c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096c63d9-38b8-441b-8c71-343db25fe88a+28:2365:x1873176850145280:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 234us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400938.968482:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 67 00010000:00010000:3.0:1786400938.970308:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb000/0x5ccaaf4f3cb1e3b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd95 expref: 27 pid: 5788 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400938.970341:0:6615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc6080380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6615:1873176872162944:192.168.204.8@tcp:104: 00010000:00010000:3.0:1786400938.970386:0:6615:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e3cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400938.970397:0:6615:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e3cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400938.970403:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e3cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400938.970429:0:6615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1786400938.970653:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e3c8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bda3 expref: 28 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400938.970672:0:6615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e3cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bda3 expref: 27 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400938.970681:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fc5599800) 00010000:00010000:3.0:1786400938.970701:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1786400938.970706:0:6615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca090e00, rc 0) 00000100:00100000:3.0:1786400938.970795:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc34c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+27:11463:x1873176850145152:12345-192.168.204.8@tcp:101:bash.0 Request processed in 13192us (13444us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1786400938.970805:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 160 00000100:00100000:1.0:1786400938.978457:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400938.979162:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850145536 00000100:00100000:0.0:1786400938.979177:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850145536 00000100:00100000:0.0:1786400938.979271:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 161 00000100:00100000:0.0:1786400938.979283:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc34c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+27:11463:x1873176850145536:12345-192.168.204.8@tcp:36:bash.0 00010000:00010000:0.0:1786400938.979741:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e3dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400938.979768:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e3dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400938.979785:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e3dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786400938.979868:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1786400938.979923:0:5789:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003f670a8a reply state 000000008ec172ae transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e3dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400938.979945:0:5789:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786400938.980129:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc34c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+30:11463:x1873176850145536:12345-192.168.204.8@tcp:36:bash.0 Request processed in 803us (1643us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1786400938.980139:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 161 00000020:00080000:0.0:1786400938.980146:0:5789:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1786400938.986655:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e3dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400938.986682:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e3dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400938.986691:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e3dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400938.986698:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5ab600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786400938.986704:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e3dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400938.986713:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e3dd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400938.986736:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fc5599800) 00010000:00010000:3.0:1786400938.986740:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400938.986746:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e3dd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400938.986753:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e3dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400938.998038:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400938.998888:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850145664 00000100:00100000:2.0:1786400938.998904:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850145664 00000100:00100000:2.0:1786400938.998985:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 162 00000100:00100000:2.0:1786400938.998996:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc34c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+29:11463:x1873176850145664:12345-192.168.204.8@tcp:101:bash.0 00010000:00010000:2.0:1786400938.999034:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400938.999059:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e3e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bdaa expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400939.000157:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e3eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400939.000182:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e3cf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bda3 expref: 30 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400939.000192:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e3eb lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400939.000235:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e3cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bda3 expref: 30 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400939.000251:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e3cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bda3 expref: 30 pid: 6615 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400939.000269:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f65180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5788:1873176872163072:192.168.204.8@tcp:104: 00000100:00100000:2.0:1786400939.000383:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec5984180 going to sleep for 11 seconds 00000100:00100000:2.0:1786400939.005794:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f65180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5788:1873176872163072:192.168.204.8@tcp:104: 00010000:00010000:2.0:1786400939.007006:0:5788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e3eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400939.008345:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400939.008764:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850145792 00000100:00100000:2.0:1786400939.008777:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850145792 00010000:00010000:2.0:1786400939.009515:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e3cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bda3 expref: 31 pid: 6615 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400939.010402:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 68 00000100:00100000:2.0:1786400939.010426:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc34c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096c63d9-38b8-441b-8c71-343db25fe88a+31:2365:x1873176850145792:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786400939.010450:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400939.010459:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e3cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bda3 expref: 31 pid: 6615 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400939.010478:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e3cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bda3 expref: 31 pid: 6615 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400939.010508:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e3cf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bda3 expref: 31 pid: 6615 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400939.010543:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fc5599800) 00010000:00010000:2.0:1786400939.010549:0:5773:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e3eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400939.010559:0:5773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e3eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400939.010568:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e3eb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400939.011912:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400939.012030:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc34c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096c63d9-38b8-441b-8c71-343db25fe88a+30:2365:x1873176850145792:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 1608us (3687us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400939.012044:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 68 00010000:00010000:3.0:1786400939.013138:0:5788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e3eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400939.013181:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e3eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400939.015494:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1786400939.015509:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786400939.015551:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e3eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.015610:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e3e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdaa expref: 30 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.015634:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e3eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdaa expref: 29 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.015644:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fc5599800) 00010000:00010000:0.0:1786400939.015647:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786400939.015651:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fee1bbe00, rc 0) 00000100:00100000:0.0:1786400939.017109:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc34c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+29:11463:x1873176850145664:12345-192.168.204.8@tcp:101:bash.0 Request processed in 18089us (19061us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400939.017135:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 162 00000100:00100000:1.0:1786400939.023416:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400939.023656:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850146048 00000100:00100000:0.0:1786400939.023673:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850146048 00000100:00100000:0.0:1786400939.024149:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 45 00000100:00100000:0.0:1786400939.024163:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc34c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+29:11463:x1873176850146048:12345-192.168.204.8@tcp:35:bash.0 00000100:00100000:0.0:1786400939.025421:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc34c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+30:11463:x1873176850146048:12345-192.168.204.8@tcp:35:bash.0 Request processed in 851us (1607us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1786400939.025436:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 45 00000100:00100000:2.0:1786400939.128396:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400939.128529:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850146304 00000100:00100000:0.0:1786400939.128542:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850146304 00000100:00100000:0.0:1786400939.128617:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 163 00000100:00100000:0.0:1786400939.128629:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+30:11473:x1873176850146304:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:0.0:1786400939.128664:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400939.128693:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1e3f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bdb1 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400939.129316:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1786400939.129536:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1e3f2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdb1 expref: 32 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.129556:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fc5599b00) 00010000:00010000:0.0:1786400939.129560:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786400939.129566:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1e3f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdb1 expref: 32 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.129582:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5aba00, rc 0) 00000100:00100000:0.0:1786400939.129666:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+31:11473:x1873176850146304:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 1039us (1284us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1786400939.129676:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 163 00000100:00100000:3.0:1786400939.132892:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400939.133164:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850146432 00000100:00100000:1.0:1786400939.133179:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850146432 00000100:00100000:1.0:1786400939.133258:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 164 00000100:00100000:1.0:1786400939.133270:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+31:11473:x1873176850146432:12345-192.168.204.8@tcp:34:lfs.0 00010000:00010000:1.0:1786400939.133375:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e400 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.133396:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e400 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.133409:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e400 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.133426:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e407 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.133434:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e407 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.133441:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e407 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.133881:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e40e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.133906:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e40e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.133914:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e40e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786400939.133970:0:6615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e40e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.133986:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e400 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.133993:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e400 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.133999:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e400 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.134005:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138f800 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400939.134010:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e400 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.134018:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e400 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.134032:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d6fc5599e00) 00010000:00010000:1.0:1786400939.134036:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400939.134041:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e400 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.134048:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e400 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.134073:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e407 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.134080:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e407 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.134578:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e407 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.134586:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138f400 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400939.134590:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e407 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.134597:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e407 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.134608:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d6fe06cbb00) 00010000:00010000:1.0:1786400939.134611:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400939.134614:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e407 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.134620:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e407 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.134639:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e40e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.134646:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e40e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.134653:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e40e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.134667:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138f200 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400939.134671:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e40e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.134677:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e40e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.134685:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fc5599800) 00010000:00010000:1.0:1786400939.134688:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400939.134690:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e40e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.134696:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e40e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400939.134898:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+31:11473:x1873176850146432:12345-192.168.204.8@tcp:34:lfs.0 Request processed in 1625us (2015us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400939.134908:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 164 00000100:00100000:1.0:1786400939.140893:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400939.141080:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850146688 00000100:00100000:2.0:1786400939.141138:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850146688 00000100:00100000:2.0:1786400939.141215:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 46 00000100:00100000:2.0:1786400939.141228:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc34c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+31:11473:x1873176850146688:12345-192.168.204.8@tcp:35:lfs.0 00000100:00100000:2.0:1786400939.141950:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc34c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+32:11473:x1873176850146688:12345-192.168.204.8@tcp:35:lfs.0 Request processed in 721us (1067us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1786400939.141960:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 46 00000100:00100000:2.0:1786400939.191378:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400939.191667:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850146944 00000100:00100000:3.0:1786400939.191681:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850146944 00000100:00100000:3.0:1786400939.191763:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 165 00000100:00100000:3.0:1786400939.191776:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+32:11476:x1873176850146944:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:3.0:1786400939.191810:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400939.191849:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e415 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bdb8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400939.191948:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091a00/0x5ccaaf4f3cb1e41c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400939.191965:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091a00/0x5ccaaf4f3cb1e41c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400939.191979:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091a00/0x5ccaaf4f3cb1e41c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400939.191996:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e423 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400939.192003:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400939.192010:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400939.192792:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090200/0x5ccaaf4f3cb1e42a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400939.192808:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090200/0x5ccaaf4f3cb1e42a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400939.192818:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090200/0x5ccaaf4f3cb1e42a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400939.192955:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1786400939.193258:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091a00/0x5ccaaf4f3cb1e41c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400939.193268:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091a00/0x5ccaaf4f3cb1e41c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400939.193276:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091a00/0x5ccaaf4f3cb1e41c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400939.193283:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca091a00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786400939.193288:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091a00/0x5ccaaf4f3cb1e41c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400939.193298:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091a00/0x5ccaaf4f3cb1e41c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400939.193314:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d6fc5599e00) 00010000:00010000:3.0:1786400939.193318:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400939.193324:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091a00/0x5ccaaf4f3cb1e41c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400939.193345:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091a00/0x5ccaaf4f3cb1e41c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400939.193363:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400939.193369:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e423 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400939.193375:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e423 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400939.193380:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca090e00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786400939.193383:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e423 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400939.193390:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e423 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400939.193397:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d6fc5599200) 00010000:00010000:3.0:1786400939.193400:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400939.193402:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e423 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400939.193408:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e423 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400939.193471:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e415 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdb8 expref: 35 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400939.193485:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090200/0x5ccaaf4f3cb1e42a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdb8 expref: 34 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400939.193499:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fc5599800) 00010000:00010000:3.0:1786400939.193502:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786400939.193505:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca090200, rc 0) 00000100:00100000:3.0:1786400939.193602:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+34:11476:x1873176850146944:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 1827us (2237us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1786400939.193614:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 165 00000100:00100000:3.0:1786400939.196798:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400939.196877:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850147072 00000100:00100000:0.0:1786400939.196891:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850147072 00000100:00100000:0.0:1786400939.196969:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 166 00000100:00100000:0.0:1786400939.197002:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+34:11476:x1873176850147072:12345-192.168.204.8@tcp:54:lfs.0 00000100:00100000:3.0:1786400939.197131:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400939.197645:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850147200 00000100:00100000:2.0:1786400939.197652:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850147200 00000100:00100000:2.0:1786400939.197722:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 13 00000100:00100000:2.0:1786400939.197731:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd571c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096c63d9-38b8-441b-8c71-343db25fe88a+35:2362:x1873176850147200:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786400939.197745:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400939.197774:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090200/0x5ccaaf4f3cb1e42a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdb8 expref: 35 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400939.197799:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fc5599800) 00010000:00010000:2.0:1786400939.197806:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400939.197887:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd571c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096c63d9-38b8-441b-8c71-343db25fe88a+34:2362:x1873176850147200:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 157us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400939.197909:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 13 00010000:00010000:0.0:1786400939.202656:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1e438 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.202690:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1e438 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.202707:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1e438 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.202754:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1e438 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.202762:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1e438 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.202769:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1e438 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.202783:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aba00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400939.202788:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1e438 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.202796:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1e438 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.202810:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fc5599800) 00010000:00010000:0.0:1786400939.202814:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786400939.202819:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1e438 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.202825:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1e438 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400939.202985:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+33:11476:x1873176850147072:12345-192.168.204.8@tcp:54:lfs.0 Request processed in 5981us (6196us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400939.202998:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 166 00000100:00100000:3.0:1786400939.211915:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400939.212068:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850147456 00000100:00100000:1.0:1786400939.212081:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850147456 00000100:00100000:1.0:1786400939.212206:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 47 00000100:00100000:1.0:1786400939.212219:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+33:11476:x1873176850147456:12345-192.168.204.8@tcp:35:lfs.0 00000100:00100000:1.0:1786400939.213135:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+34:11476:x1873176850147456:12345-192.168.204.8@tcp:35:lfs.0 Request processed in 865us (1178us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1786400939.213148:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 47 00000100:00100000:3.0:1786400939.393598:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400939.393747:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850147712 00000100:00100000:0.0:1786400939.393761:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850147712 00000100:00100000:0.0:1786400939.394350:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 167 00000100:00100000:0.0:1786400939.394367:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+34:11494:x1873176850147712:12345-192.168.204.8@tcp:101:cat.0 00010000:00010000:0.0:1786400939.394400:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400939.394427:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1e43f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bdbf expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.394597:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e446 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.394615:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e446 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.394630:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e446 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400939.394644:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1786400939.396358:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1e43f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdbf expref: 37 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.396396:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e446 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdbf expref: 36 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.396406:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fc5599800) 00010000:00010000:0.0:1786400939.396431:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1786400939.396436:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5aa600, rc 0) 00000100:00100000:0.0:1786400939.398183:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+36:11494:x1873176850147712:12345-192.168.204.8@tcp:101:cat.0 Request processed in 3800us (4585us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1786400939.398201:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 167 00000100:00100000:3.0:1786400939.434287:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400939.434339:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850147840 00000100:00100000:0.0:1786400939.434353:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850147840 00000100:00100000:0.0:1786400939.435004:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 168 00000100:00100000:0.0:1786400939.435020:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+36:11495:x1873176850147840:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:0.0:1786400939.435057:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400939.435123:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1e454 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bdc6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.435217:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e45b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.435234:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e45b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.435253:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e45b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400939.435533:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1786400939.435538:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1786400939.435619:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e45b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.435656:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1e454 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdc6 expref: 38 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.435695:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e45b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdc6 expref: 37 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.435706:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d6fc5599e00) 00010000:00010000:0.0:1786400939.435710:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786400939.435716:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5aaa00, rc 0) 00000100:00100000:0.0:1786400939.435801:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+37:11495:x1873176850147840:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 786us (1529us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400939.435809:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 168 00000100:00100000:3.0:1786400939.442360:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400939.442693:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850148224 00000100:00100000:1.0:1786400939.442708:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850148224 00000100:00100000:1.0:1786400939.442793:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 48 00000100:00100000:1.0:1786400939.442806:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+37:11495:x1873176850148224:12345-192.168.204.8@tcp:35:lfs.0 00000100:00100000:1.0:1786400939.443680:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+38:11495:x1873176850148224:12345-192.168.204.8@tcp:35:lfs.0 Request processed in 872us (1330us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1786400939.443693:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 48 00000100:00100000:3.0:1786400939.447367:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400939.447517:0:8369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850148352 00000100:00100000:1.0:1786400939.447532:0:8369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850148352 00000100:00100000:1.0:1786400939.447621:0:8369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14 00000100:00100000:1.0:1786400939.447632:0:8369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4588050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+38:11495:x1873176850148352:12345-192.168.204.8@tcp:103:lfs.0 00010000:00010000:1.0:1786400939.447653:0:8369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1786400939.447687:0:8369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e3eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdaa expref: 38 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.447712:0:8369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e446 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdbf expref: 37 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.447727:0:8369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090400/0x5ccaaf4f3cb1e2ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd6b expref: 36 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.447740:0:8369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fc5599800) 00010000:00010000:1.0:1786400939.447753:0:8369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400939.448021:0:8369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4588050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+35:11495:x1873176850148352:12345-192.168.204.8@tcp:103:lfs.0 Request processed in 390us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400939.448031:0:8369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14 00000100:00100000:3.0:1786400939.450807:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400939.451230:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850148480 00000100:00100000:1.0:1786400939.451245:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850148480 00000100:00100000:1.0:1786400939.451993:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 169 00000100:00100000:1.0:1786400939.452026:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+35:11495:x1873176850148480:12345-192.168.204.8@tcp:58:lfs.0 00010000:00010000:1.0:1786400939.452216:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e462 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.452236:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e462 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.452251:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e462 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786400939.452669:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1786400939.452791:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+35:11495:x1873176850148480:12345-192.168.204.8@tcp:58:lfs.0 Request processed in 767us (1994us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400939.452801:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 169 00000100:00100000:3.0:1786400939.473367:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400939.473569:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850148608 00000100:00100000:1.0:1786400939.473757:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850148608 00000100:00100000:1.0:1786400939.473843:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 170 00000100:00100000:1.0:1786400939.473855:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+35:11497:x1873176850148608:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:1.0:1786400939.473885:0:6615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400939.473913:0:6615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e469 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bdcd expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.474858:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1e470 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.474876:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1e470 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.474890:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1e470 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.475131:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e477 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.475141:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e477 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.475148:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e477 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.475567:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e47e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.475578:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e47e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.475586:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e47e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400939.475632:0:6615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1786400939.475638:0:6615:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786400939.475660:0:6615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e47e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.475673:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e47e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.475683:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1e470 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.475690:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1e470 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.475708:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1e470 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.475714:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138ea00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400939.475719:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1e470 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.475728:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1e470 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.475742:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d6fc5599e00) 00010000:00010000:1.0:1786400939.475746:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400939.475752:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1e470 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.475758:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1e470 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.475774:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e477 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.475781:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e477 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.475787:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e477 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.475792:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138f200 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400939.475795:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e477 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.475813:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e477 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.475823:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d6fe06cb500) 00010000:00010000:1.0:1786400939.475825:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400939.475828:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e477 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.475834:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e477 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.475877:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e469 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdcd expref: 37 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.475892:0:6615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e47e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdcd expref: 36 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.475900:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fe06cbb00) 00010000:00010000:1.0:1786400939.475902:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786400939.475904:0:6615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138fa00, rc 0) 00000100:00100000:1.0:1786400939.478065:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+36:11497:x1873176850148608:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 4197us (4699us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400939.478081:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 170 00000040:00080000:0.0:1786400939.695824:0:11546:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786400939.696330:0:11546:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786400939.696386:0:11546:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:0.0:1786400939.696393:0:11546:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786400939.696566:0:11546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdb87b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11546:1873176872163200:192.168.204.8@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1786400939.696744:0:11546:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff6ec9300 going to sleep for 11 seconds 00000100:00100000:0.0:1786400939.711028:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400939.711432:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850148736 00000100:00100000:3.0:1786400939.711444:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850148736 00000100:00100000:3.0:1786400939.711510:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 171 00000100:00100000:3.0:1786400939.711523:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdb87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+37:11508:x1873176850148736:12345-192.168.204.8@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1786400939.711644:0:5789:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786400939.711834:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdb87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+37:11508:x1873176850148736:12345-192.168.204.8@tcp:53:lhsmtool_posix.0 Request processed in 310us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400939.711850:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 171 00000100:00100000:2.0:1786400939.712682:0:11546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdb87b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11546:1873176872163200:192.168.204.8@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1786400939.717426:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400939.717684:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850148864 00000100:00100000:0.0:1786400939.717699:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850148864 00000100:00100000:0.0:1786400939.717778:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 172 00000100:00100000:0.0:1786400939.717790:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+36:11508:x1873176850148864:12345-192.168.204.8@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1786400939.718301:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e485 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.718327:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e485 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.718365:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e485 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.718385:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e48c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.718392:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e48c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.718399:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e48c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.718433:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e493 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.718442:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.718450:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400939.718502:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1786400939.718507:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786400939.718537:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.718552:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e485 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.718559:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e485 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.718576:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e485 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.718584:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5ab800 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400939.718589:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e485 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.718598:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e485 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.718613:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d6fc5599600) 00010000:00010000:0.0:1786400939.718617:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400939.718623:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e485 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.718629:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e485 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.718646:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e48c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.718653:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e48c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.718659:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e48c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.718664:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5ab200 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400939.718668:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e48c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.718683:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e48c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.718692:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9d6fc90cde00) 00010000:00010000:0.0:1786400939.718694:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400939.718697:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e48c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.718703:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e48c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.718720:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.718726:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e493 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.718732:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e493 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.718738:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aa200 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400939.718741:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e493 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.718747:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e493 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.718753:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fe06cbb00) 00010000:00010000:0.0:1786400939.718756:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400939.718759:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e493 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.718774:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e493 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400939.719776:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+36:11508:x1873176850148864:12345-192.168.204.8@tcp:34:lhsmtool_posix.0 Request processed in 1976us (2352us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400939.719791:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 172 00000100:00100000:3.0:1786400939.723760:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400939.724021:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850149120 00000100:00100000:1.0:1786400939.724034:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850149120 00000100:00100000:1.0:1786400939.724893:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 173 00000100:00100000:1.0:1786400939.724908:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+36:11508:x1873176850149120:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786400939.724948:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400939.724976:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e49a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bdd4 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.725154:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e4a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.725172:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.725187:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400939.725203:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1786400939.725430:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.725439:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e4a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.725446:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e4a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.725452:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138f200 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400939.725458:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e4a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.725467:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e4a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.725482:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fe06cbb00) 00010000:00010000:0.0:1786400939.725486:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786400939.725491:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e4a1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.725499:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e4a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.725646:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e49a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdd4 expref: 38 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.725666:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d6fc5599600) 00010000:00010000:0.0:1786400939.725668:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786400939.725672:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e49a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdd4 expref: 38 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.725683:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138f800, rc 0) 00000100:00100000:0.0:1786400939.725776:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+37:11508:x1873176850149120:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 872us (2029us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1786400939.725786:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 173 00000100:00100000:3.0:1786400939.734651:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400939.735061:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850149248 00000100:00100000:1.0:1786400939.735074:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850149248 00000100:00100000:1.0:1786400939.735172:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 174 00000100:00100000:1.0:1786400939.735184:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+37:11508:x1873176850149248:12345-192.168.204.8@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1786400939.735235:0:6615:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1786400939.735388:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+37:11508:x1873176850149248:12345-192.168.204.8@tcp:53:lhsmtool_posix.0 Request processed in 205us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400939.735397:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 174 00000100:00100000:1.0:1786400939.748548:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400939.748750:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850149504 00000100:00100000:2.0:1786400939.748763:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850149504 00000100:00100000:2.0:1786400939.748835:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 175 00000100:00100000:2.0:1786400939.748847:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc34c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+37:11508:x1873176850149504:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786400939.748877:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400939.748882:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1786400939.748920:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e45b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdc6 expref: 37 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400939.748947:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d6fc5599e00) 00010000:00010000:2.0:1786400939.748953:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786400939.748972:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bac00/0x5ccaaf4f3cb1e4af lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bddb expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786400939.749960:0:5790:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1786400939.750369:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bae00/0x5ccaaf4f3cb1e4b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400939.750389:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bae00/0x5ccaaf4f3cb1e4b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400939.750403:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bae00/0x5ccaaf4f3cb1e4b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400939.750485:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bac00/0x5ccaaf4f3cb1e4af lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bddb expref: 39 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400939.750514:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bae00/0x5ccaaf4f3cb1e4b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bddb expref: 38 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400939.750524:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d6fd022e100) 00010000:00010000:2.0:1786400939.750527:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786400939.750530:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fee1bae00, rc 0) 00000100:00100000:2.0:1786400939.750628:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc34c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+38:11508:x1873176850149504:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 1782us (2093us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1786400939.750638:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 175 00000100:00100000:3.0:1786400939.756807:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400939.759242:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872163328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786400939.759333:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400939.759639:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872163328 00000100:00100000:2.0:1786400939.759650:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872163328 00000100:00100000:2.0:1786400939.759737:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1786400939.759749:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1873176872163328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786400939.759795:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400939.759861:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1873176872163328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400939.759869:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1786400939.760123:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786400939.760171:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872163328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786400939.760323:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850149760 00000100:00100000:1.0:1786400939.760330:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850149760 00000100:00100000:0.0:1786400939.760529:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 176 00000100:00100000:0.0:1786400939.760539:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+38:11508:x1873176850149760:12345-192.168.204.8@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1786400939.760605:0:6615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400939.760639:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bae00/0x5ccaaf4f3cb1e4b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bddb expref: 38 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.760661:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d6fd022e100) 00010000:00010000:0.0:1786400939.760675:0:6615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786400939.760706:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e4c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.760722:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e4c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.760734:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e4c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.760750:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e4cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x17d87a7f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.760773:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e4cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x17d87a7f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.760780:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e4cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x17d87a7f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.761389:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e4c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.761399:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e4c4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.761406:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e4c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.761412:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5ab200 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400939.761417:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e4c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.761425:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e4c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.761437:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d6fc5599e00) 00010000:00010000:0.0:1786400939.761440:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400939.761444:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e4c4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.761451:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e4c4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.761463:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e4cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x17d87a7f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.761476:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e4cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x17d87a7f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.761481:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e4cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x17d87a7f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.761486:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5ab800 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400939.761489:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e4cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x17d87a7f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.761495:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e4cb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x17d87a7f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.761504:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x17d87a7f (ffff9d6fc90cde00) 00010000:00010000:0.0:1786400939.761507:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400939.761769:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e4cb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x17d87a7f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.761778:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e4cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x17d87a7f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400939.762071:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+37:11508:x1873176850149760:12345-192.168.204.8@tcp:36:lhsmtool_posix.0 Request processed in 1530us (5274us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786400939.762080:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 176 00000100:00100000:3.0:1786400939.765701:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400939.766073:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850149888 00000100:00100000:0.0:1786400939.766756:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850149888 00000100:00100000:0.0:1786400939.766853:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 177 00000100:00100000:0.0:1786400939.766867:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+37:11508:x1873176850149888:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786400939.766899:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400939.766951:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1e4d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bde2 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.767430:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e4d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.767450:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.767466:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.767600:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1e4d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bde2 expref: 39 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.767627:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e4d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bde2 expref: 38 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.767637:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:0.0:1786400939.767640:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786400939.767644:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5aa200, rc 0) 00000100:00100000:0.0:1786400939.767728:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+38:11508:x1873176850149888:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 864us (2039us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400939.767738:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 177 00000100:00100000:1.0:1786400939.787339:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400939.787408:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850150144 00000100:00100000:1.0:1786400939.787421:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850150144 00000100:00100000:1.0:1786400939.787495:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 178 00000100:00100000:1.0:1786400939.787525:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc34c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+38:11508:x1873176850150144:12345-192.168.204.8@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1786400939.787640:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e4e0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.787661:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e4e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.787675:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e4e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786400939.790244:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1786400939.790266:0:5788:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 392191179469ns, next at 393191175703ns, rc = 0 00000004:00010000:1.0:1786400939.790421:0:5788:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000085a64c34 reply state 00000000f89a413b transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e4e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400939.790436:0:5788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786400939.790606:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc34c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+40:11508:x1873176850150144:12345-192.168.204.8@tcp:36:lhsmtool_posix.0 Request processed in 3076us (3276us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1786400939.790618:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 178 00000100:00100000:3.0:1786400939.799997:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:1.0:1786400939.803633:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e4e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.803660:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e4e0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.803670:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e4e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.803677:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138e600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400939.803684:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e4e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.803706:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e4e0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.803732:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:1.0:1786400939.803736:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786400939.803742:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e4e0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.803749:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e4e0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400939.806735:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850150272 00000100:00100000:0.0:1786400939.806755:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850150272 00000100:00100000:0.0:1786400939.806918:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 179 00000100:00100000:0.0:1786400939.806931:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+39:11508:x1873176850150272:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786400939.806971:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400939.807011:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1e4e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bde9 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.807604:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1e4e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bde9 expref: 40 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.807627:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1e4e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bde9 expref: 40 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.807655:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:0.0:1786400939.807658:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786400939.807662:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5ab400, rc 0) 00000100:00100000:0.0:1786400939.807744:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+40:11508:x1873176850150272:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 815us (7763us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400939.807752:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 179 00000100:00100000:3.0:1786400939.812931:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400939.812975:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850150400 00000100:00100000:3.0:1786400939.812988:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850150400 00000100:00100000:3.0:1786400939.813069:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 52 00000100:00100000:3.0:1786400939.813082:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+6:2365:x1873176850150400:12345-192.168.204.8@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1786400939.815763:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+7:2365:x1873176850150400:12345-192.168.204.8@tcp:2:lhsmtool_posix.0 Request processed in 2675us (2838us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1786400939.815777:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 52 00000100:00080000:3.0:1786400939.815823:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786400939.821425:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400939.821602:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850150656 00000100:00100000:3.0:1786400939.821615:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850150656 00000100:00100000:3.0:1786400939.821690:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 49 00000100:00100000:3.0:1786400939.821702:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc34c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+40:11508:x1873176850150656:12345-192.168.204.8@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1786400939.822008:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc34c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+41:11508:x1873176850150656:12345-192.168.204.8@tcp:35:lhsmtool_posix.0 Request processed in 307us (594us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1786400939.822016:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 49 00000100:00100000:2.0:1786400939.827165:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400939.829458:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850150912 00000100:00100000:0.0:1786400939.829479:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850150912 00000100:00100000:0.0:1786400939.830206:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 180 00000100:00100000:0.0:1786400939.830359:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+41:11508:x1873176850150912:12345-192.168.204.8@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1786400939.830510:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+41:11508:x1873176850150912:12345-192.168.204.8@tcp:57:lhsmtool_posix.0 Request processed in 292us (3353us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400939.830518:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 180 00000100:00100000:3.0:1786400939.834851:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400939.834944:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850151040 00000100:00100000:0.0:1786400939.834957:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850151040 00000100:00100000:0.0:1786400939.835032:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 181 00000100:00100000:0.0:1786400939.835044:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+41:11508:x1873176850151040:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786400939.835073:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400939.835340:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e4ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bdf0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.835456:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1e4f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.835473:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1e4f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.835488:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1e4f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400939.835537:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786400939.835560:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1e4f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.835591:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e4ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdf0 expref: 43 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.835614:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1e4f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdf0 expref: 42 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400939.835623:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:0.0:1786400939.835627:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1786400939.835632:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5aba00, rc 0) 00000100:00100000:0.0:1786400939.835759:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+42:11508:x1873176850151040:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 716us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400939.835768:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 181 00000100:00100000:1.0:1786400939.849400:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400939.849801:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850151168 00000100:00100000:2.0:1786400939.849815:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850151168 00000100:00100000:2.0:1786400939.849947:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 53 00000100:00100000:2.0:1786400939.849960:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+7:2364:x1873176850151168:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786400939.849987:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400939.850016:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0268576/0x5ccaaf4f3cb1e4fc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bdf7 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786400939.850074:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a7a50aa, blocks: 0x1 00010000:00010000:2.0:1786400939.850374:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=392s v=(0 0) 00010000:00010000:2.0:1786400939.850381:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400939.850394:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0268576/0x5ccaaf4f3cb1e4fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdf7 expref: 8 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400939.850420:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a0268576/0x5ccaaf4f3cb1e4fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdf7 expref: 8 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400939.850436:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fee1bac00, rc 0) 00000100:00100000:2.0:1786400939.850517:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+8:2364:x1873176850151168:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 559us (1129us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400939.850525:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 53 00000100:00100000:1.0:1786400939.855967:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400939.856982:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850151424 00000100:00100000:0.0:1786400939.856997:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850151424 00000100:00100000:0.0:1786400939.857153:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 182 00000100:00100000:0.0:1786400939.857166:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+42:11508:x1873176850151424:12345-192.168.204.8@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1786400939.857312:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+42:11508:x1873176850151424:12345-192.168.204.8@tcp:57:lhsmtool_posix.0 Request processed in 148us (1358us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400939.857321:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 182 00000100:00100000:2.0:1786400939.860740:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400939.860930:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850151552 00000100:00100000:1.0:1786400939.860943:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850151552 00000100:00100000:1.0:1786400939.861019:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 54 00000100:00100000:1.0:1786400939.861031:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+8:11508:x1873176850151552:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786400939.861054:0:6593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400939.861078:0:6593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001253adbc/0x5ccaaf4f3cb1e503 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bdfe expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.861366:0:6593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0268576/0x5ccaaf4f3cb1e4fc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdf7 expref: 9 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.861377:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786400939.861382:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786400939.861388:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001253adbc/0x5ccaaf4f3cb1e503 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdfe expref: 9 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.861451:0:6593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a0268576/0x5ccaaf4f3cb1e4fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdf7 expref: 9 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.861467:0:6593:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a0268576/0x5ccaaf4f3cb1e4fc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdf7 expref: 9 pid: 6590 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400939.861485:0:6593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc4987480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6593:1873176872163456:192.168.204.8@tcp:104: 00000100:00100000:1.0:1786400939.861926:0:6593:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fee1f3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1786400939.865915:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400939.866073:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850151680 00000100:00100000:2.0:1786400939.866212:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850151680 00010000:00010000:2.0:1786400939.866278:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a0268576/0x5ccaaf4f3cb1e4fc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdf7 expref: 10 pid: 6590 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400939.866326:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 69 00000100:00100000:2.0:1786400939.866340:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096c63d9-38b8-441b-8c71-343db25fe88a+10:2365:x1873176850151680:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786400939.866361:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400939.866391:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a0268576/0x5ccaaf4f3cb1e4fc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdf7 expref: 10 pid: 6590 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400939.866426:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a0268576/0x5ccaaf4f3cb1e4fc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdf7 expref: 10 pid: 6590 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400939.866462:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400939.866468:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400939.866477:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001253adbc/0x5ccaaf4f3cb1e503 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdfe expref: 10 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400939.866490:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001253adbc/0x5ccaaf4f3cb1e503 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdfe expref: 10 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400939.866543:0:5775:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001253adbc/0x5ccaaf4f3cb1e503 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdfe expref: 10 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400939.866577:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f65f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5775:1873176872163584:192.168.204.8@tcp:105: 00000100:00100000:2.0:1786400939.866684:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec5984180 going to sleep for 11 seconds 00010000:00010000:1.0:1786400939.867892:0:6593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0268576/0x5ccaaf4f3cb1e4fc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdf7 expref: 10 pid: 6590 timeout: 492 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400939.867919:0:6593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc4987480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6593:1873176872163456:192.168.204.8@tcp:104: 00010000:00010000:1.0:1786400939.867953:0:6593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001253adbc/0x5ccaaf4f3cb1e503 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdfe expref: 9 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400939.867967:0:6593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138ea00, rc 0) 00000100:00100000:1.0:1786400939.868398:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+9:11508:x1873176850151552:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 7367us (7670us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400939.868408:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 54 00000100:00100000:2.0:1786400939.870831:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f65f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5775:1873176872163584:192.168.204.8@tcp:105: 00010000:00010000:2.0:1786400939.870866:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400939.871386:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096c63d9-38b8-441b-8c71-343db25fe88a+8:2365:x1873176850151680:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 5045us (5481us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400939.871398:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 69 00000100:00100000:2.0:1786400939.874330:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400939.874422:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850151808 00000100:00100000:1.0:1786400939.874437:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850151808 00002000:00100000:1.0:1786400939.874507:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9d6ff5f65f80 x1873176850151808/t0(0) o4->096c63d9-38b8-441b-8c71-343db25fe88a@192.168.204.8@tcp:735/0 lens 504/0 e 0 to 0 dl 1786400950 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786400939.874667:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ff5f65f80 with x1873176850151808 ext(0->8) 00002000:00010000:1.0:1786400939.874675:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d6ff5f65f80 00000100:00100000:1.0:1786400939.874716:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 5 00000100:00100000:1.0:1786400939.874727:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:096c63d9-38b8-441b-8c71-343db25fe88a+8:2364:x1873176850151808:12345-192.168.204.8@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1786400939.878769:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:096c63d9-38b8-441b-8c71-343db25fe88a+10:2364:x1873176850151808:12345-192.168.204.8@tcp:4:lhsmtool_posix.0 Request processed in 4033us (4442us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1786400939.878785:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 5 00002000:00100000:1.0:1786400939.878797:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9d6ff5f65f80 x1873176850151808/t4294967315(0) o4->096c63d9-38b8-441b-8c71-343db25fe88a@192.168.204.8@tcp:735/0 lens 504/448 e 0 to 0 dl 1786400950 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786400939.878808:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ff5f65f80 with x1873176850151808 ext(0->8) 00002000:00010000:1.0:1786400939.878814:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d6ff5f65f80 00000100:00100000:1.0:1786400939.885532:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400939.886002:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850151936 00000100:00100000:0.0:1786400939.886016:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850151936 00000100:00100000:0.0:1786400939.886338:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 183 00000100:00100000:0.0:1786400939.886353:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+42:11508:x1873176850151936:12345-192.168.204.8@tcp:44:lhsmtool_posix.0 00010000:00010000:3.0:1786400939.951118:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400939.975431:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+42:11508:x1873176850151936:12345-192.168.204.8@tcp:44:lhsmtool_posix.0 Request processed in 89071us (89903us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400939.975445:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 183 00000001:00080000:1.0:1786400939.975486:0:5810:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000001:00080000:1.0:1786400939.975582:0:5810:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:1.0:1786400939.975587:0:5810:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:1.0:1786400939.975624:0:5810:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:1.0:1786400939.975640:0:5810:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1786400939.975873:0:5822:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1786400939.975886:0:5822:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1786400939.975901:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd59b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872163712:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786400939.975955:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400939.976137:0:11770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872163712 00000100:00100000:1.0:1786400939.976145:0:11770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872163712 00000100:00100000:1.0:1786400939.976198:0:11770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1786400939.976207:0:11770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd59a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872163712:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1786400939.976357:0:11770:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1786400939.976360:0:11770:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1786400938 00002000:00010000:1.0:1786400939.976362:0:11770:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786400939.976365:0:11770:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1786400938 -> 1786400938 00002000:00010000:1.0:1786400939.976367:0:11770:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1786400939.976403:0:11770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd59a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1873176872163712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 197us (448us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1786400939.976411:0:11770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1786400939.976429:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1786400939.976463:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d6ffd59b480/2, rc 0, transno 4294967316 00000100:00100000:1.0:1786400939.976469:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd59b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872163712:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1786400939.981600:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400939.983321:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850152064 00000100:00100000:3.0:1786400939.983334:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850152064 00000100:00100000:3.0:1786400939.983404:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 56 00000100:00100000:3.0:1786400939.983416:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+10:2365:x1873176850152064:12345-192.168.204.8@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1786400940.028382:0:7501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:1.0:1786400940.028399:0:7501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1786400940.028955:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+7:2365:x1873176850152064:12345-192.168.204.8@tcp:16:lhsmtool_posix.0 Request processed in 45535us (47359us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400940.028968:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 56 00000100:00100000:0.0:1786400940.035231:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400940.035282:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850152320 00000100:00100000:1.0:1786400940.035293:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850152320 00000100:00100000:1.0:1786400940.035376:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 184 00000100:00100000:1.0:1786400940.035386:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdb86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+18:11508:x1873176850152320:12345-192.168.204.8@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1786400940.035441:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400940.035470:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1e4f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdf0 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1786400940.036378:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1786400940.036462:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:1.0:1786400940.036468:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786400940.036506:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e50a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.036583:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e50a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.036594:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e50a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786400940.037229:0:5788:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005fd138fe reply state 00000000d95a37f8 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e50a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400940.037243:0:5788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786400940.037414:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdb86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+19:11508:x1873176850152320:12345-192.168.204.8@tcp:36:lhsmtool_posix.0 Request processed in 2026us (2191us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1786400940.037423:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 184 00010000:00010000:2.0:1786400940.040750:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e50a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.040769:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e50a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.040777:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e50a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.040796:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138f800 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400940.040801:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e50a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.040809:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e50a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.040836:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:2.0:1786400940.040841:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400940.040845:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e50a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.040851:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e50a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400940.043320:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400940.043424:0:11770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850152448 00000100:00100000:2.0:1786400940.043434:0:11770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850152448 00000100:00100000:2.0:1786400940.043483:0:11770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 57 00000100:00100000:2.0:1786400940.043493:0:11770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:096c63d9-38b8-441b-8c71-343db25fe88a+7:2365:x1873176850152448:12345-192.168.204.8@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1786400940.043926:0:11770:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1786400940.043930:0:11770:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1786400938 -> 1786400937 00002000:00010000:2.0:1786400940.043933:0:11770:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1786400935 00002000:00010000:2.0:1786400940.043940:0:11770:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1786400938 -> 1786400937 00002000:00010000:2.0:1786400940.043943:0:11770:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1786400940.044048:0:11770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:096c63d9-38b8-441b-8c71-343db25fe88a+8:2365:x1873176850152448:12345-192.168.204.8@tcp:2:lhsmtool_posix.0 Request processed in 554us (734us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1786400940.044057:0:11770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 57 00000100:00100000:1.0:1786400940.047495:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400940.047974:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850152704 00000100:00100000:0.0:1786400940.047985:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850152704 00000100:00100000:0.0:1786400940.048234:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 185 00000100:00100000:0.0:1786400940.048245:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd59b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+18:11508:x1873176850152704:12345-192.168.204.8@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1786400940.048311:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e511 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.048328:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e4d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bde2 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.048338:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e511 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.048374:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e4d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bde2 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.048387:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e4d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bde2 expref: 18 pid: 5789 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400940.048408:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdb87b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5789:1873176872163840:192.168.204.8@tcp:104: 00000100:00100000:0.0:1786400940.048541:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffa3ae600 going to sleep for 11 seconds 00000100:00100000:1.0:1786400940.055281:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400940.055319:0:8369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850152832 00000100:00100000:1.0:1786400940.055327:0:8369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850152832 00010000:00010000:1.0:1786400940.055370:0:8369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e4d9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bde2 expref: 19 pid: 5789 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400940.055406:0:8369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 70 00000100:00100000:1.0:1786400940.055416:0:8369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd599180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+19:2364:x1873176850152832:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400940.055430:0:8369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400940.055437:0:8369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e4d9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bde2 expref: 19 pid: 5789 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.055464:0:8369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e4d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bde2 expref: 19 pid: 5789 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.055487:0:8369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:1.0:1786400940.055492:0:8369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e511 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.055503:0:8369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e511 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.055510:0:8369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e511 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.055529:0:8369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400940.055578:0:8369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd599180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+19:2364:x1873176850152832:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 163us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400940.055586:0:8369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 70 00010000:00010000:2.0:1786400940.056632:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e4d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bde2 expref: 18 pid: 5789 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400940.056651:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdb87b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5789:1873176872163840:192.168.204.8@tcp:104: 00010000:00010000:2.0:1786400940.056675:0:5789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e511 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.056684:0:5789:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e511 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.056848:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e511 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.056881:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e511 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.056888:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e511 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.056894:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e511 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.056900:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aa400 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400940.056904:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e511 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.056923:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e511 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.056935:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:2.0:1786400940.056938:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1786400940.056942:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e511 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.056950:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e511 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400940.057010:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd59b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+17:11508:x1873176850152704:12345-192.168.204.8@tcp:55:lhsmtool_posix.0 Request processed in 8766us (9525us total) trans 0 rc -22/-22 00000100:00100000:2.0:1786400940.057019:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 185 00000100:00100000:1.0:1786400940.059673:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400940.059835:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850152960 00000100:00100000:2.0:1786400940.059845:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850152960 00000100:00100000:2.0:1786400940.059934:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 58 00000100:00100000:2.0:1786400940.059945:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+8:2364:x1873176850152960:12345-192.168.204.8@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1786400940.060367:0:6593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f9656702/0x5ccaaf4f3cb1e518 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.060389:0:6593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001253adbc/0x5ccaaf4f3cb1e503 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdfe expref: 8 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.060397:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400940.060401:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786400940.060405:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9656702/0x5ccaaf4f3cb1e518 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.060447:0:6593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001253adbc/0x5ccaaf4f3cb1e503 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdfe expref: 8 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.060462:0:6593:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001253adbc/0x5ccaaf4f3cb1e503 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdfe expref: 8 pid: 6593 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400940.060476:0:6593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f66d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6593:1873176872163968:192.168.204.8@tcp:104: 00000100:00100000:2.0:1786400940.060732:0:6593:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec5984d80 going to sleep for 11 seconds 00000100:00100000:1.0:1786400940.065785:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400940.065882:0:6593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f66d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6593:1873176872163968:192.168.204.8@tcp:104: 00010000:00010000:0.0:1786400940.065910:0:6593:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f9656702/0x5ccaaf4f3cb1e518 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400940.066061:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850153088 00000100:00100000:3.0:1786400940.066069:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850153088 00010000:00010000:3.0:1786400940.066537:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001253adbc/0x5ccaaf4f3cb1e503 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdfe expref: 9 pid: 6593 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400940.066768:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 71 00000100:00100000:3.0:1786400940.066779:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd598a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096c63d9-38b8-441b-8c71-343db25fe88a+9:2364:x1873176850153088:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786400940.066794:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400940.066817:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001253adbc/0x5ccaaf4f3cb1e503 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdfe expref: 9 pid: 6593 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.066831:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001253adbc/0x5ccaaf4f3cb1e503 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdfe expref: 9 pid: 6593 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.066855:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001253adbc/0x5ccaaf4f3cb1e503 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdfe expref: 9 pid: 6593 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.066870:0:5774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786400940.066875:0:5774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786400940.066888:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9656702/0x5ccaaf4f3cb1e518 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.066897:0:5774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9656702/0x5ccaaf4f3cb1e518 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.067268:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400940.067328:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd598a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096c63d9-38b8-441b-8c71-343db25fe88a+8:2364:x1873176850153088:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 550us (1551us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400940.067337:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 71 00010000:00010000:1.0:1786400940.067739:0:6593:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f9656702/0x5ccaaf4f3cb1e518 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.067751:0:6593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9656702/0x5ccaaf4f3cb1e518 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.067780:0:6593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f9656702/0x5ccaaf4f3cb1e518 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.067800:0:6593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9656702/0x5ccaaf4f3cb1e518 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.067808:0:6593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9656702/0x5ccaaf4f3cb1e518 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.067815:0:6593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1bbe00 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:1.0:1786400940.067820:0:6593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9656702/0x5ccaaf4f3cb1e518 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.067829:0:6593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9656702/0x5ccaaf4f3cb1e518 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.067841:0:6593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9656702/0x5ccaaf4f3cb1e518 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.067849:0:6593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9656702/0x5ccaaf4f3cb1e518 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400940.067899:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd599c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+7:2364:x1873176850152960:12345-192.168.204.8@tcp:1:lhsmtool_posix.0 Request processed in 7955us (8231us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400940.067907:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 58 00000100:00100000:1.0:1786400940.072783:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400940.072950:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850153344 00000100:00100000:0.0:1786400940.072960:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850153344 00000100:00100000:0.0:1786400940.073249:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 186 00000100:00100000:0.0:1786400940.073260:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+17:11508:x1873176850153344:12345-192.168.204.8@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1786400940.073342:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1e51f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.073360:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1e51f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.073373:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1e51f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.073595:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e526 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.073607:0:6615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1e4e7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bde9 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.073616:0:6615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e526 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.073658:0:6615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1e4e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bde9 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.073684:0:6615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1e4e7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bde9 expref: 18 pid: 5789 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400940.073699:0:6615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdb85f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6615:1873176872164096:192.168.204.8@tcp:104: 00000100:00100000:0.0:1786400940.074424:0:6615:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffa3ae600 going to sleep for 11 seconds 00000100:00100000:0.0:1786400940.078656:0:6615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdb85f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6615:1873176872164096:192.168.204.8@tcp:104: 00010000:00010000:0.0:1786400940.078821:0:6615:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e526 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400940.082038:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400940.082129:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400940.082161:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400940.082191:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400940.082222:0:8369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850153856 00000100:00100000:3.0:1786400940.082230:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850153600 00000100:00100000:1.0:1786400940.082231:0:8369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850153856 00000100:00100000:3.0:1786400940.082234:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850153600 00010000:00010000:1.0:1786400940.082267:0:8369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1e4e7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bde9 expref: 19 pid: 5789 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400940.082282:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 63 00000100:00100000:1.0:1786400940.082289:0:8369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 72 00000100:00100000:1.0:1786400940.082294:0:8369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd598000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+19:2364:x1873176850153856:12345-192.168.204.8@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1786400940.082297:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd59b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+7:2364:x1873176850153600:12345-192.168.204.8@tcp:400:kworker.0 00010000:00010000:1.0:1786400940.082308:0:8369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400940.082314:0:8369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1e4e7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bde9 expref: 19 pid: 5789 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.082326:0:8369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1e4e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bde9 expref: 19 pid: 5789 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.082347:0:8369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1e4e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bde9 expref: 19 pid: 5789 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.082361:0:8369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d6fc90cd300) 00000100:00100000:3.0:1786400940.082364:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd59b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+7:2364:x1873176850153600:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 75us (338us total) trans 0 rc 0/0 00010000:00010000:1.0:1786400940.082367:0:8369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e526 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400940.082371:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 63 00010000:00010000:1.0:1786400940.082376:0:8369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e526 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.082382:0:8369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e526 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.082407:0:8369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400940.082432:0:8369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd598000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+18:2364:x1873176850153856:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 136us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400940.082438:0:8369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 72 00000100:00100000:1.0:1786400940.082462:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850153728 00000100:00100000:1.0:1786400940.082466:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850153728 00000100:00100000:1.0:1786400940.082500:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 149 00000100:00100000:1.0:1786400940.082507:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2364:x1873176850153728:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:1.0:1786400940.082543:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2364:x1873176850153728:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 37us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400940.082550:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 149 00010000:00010000:1.0:1786400940.082605:0:6615:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e526 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.082614:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e526 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1786400940.082675:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1786400940.082680:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1786400940.082817:0:6615:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1786400940.082969:0:6615:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1786400940.083015:0:6615:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1786400940.083138:0:6615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd59a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6615:1873176872164224:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1786400940.083188:0:6615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400940.083222:0:6615:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc480f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400940.083391:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872164224 00000100:00100000:2.0:1786400940.083397:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872164224 00000100:00100000:2.0:1786400940.083475:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1786400940.083484:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6615:x1873176872164224:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1786400940.083825:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6615:x1873176872164224:12345-0@lo:1000:mdt00_003.0 Request processed in 341us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400940.083833:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1786400940.086241:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850153472 00000100:00100000:0.0:1786400940.086255:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850153472 00000100:00100000:0.0:1786400940.086326:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 292 00000100:00100000:0.0:1786400940.086337:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2364:x1873176850153472:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786400940.086417:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2364:x1873176850153472:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 81us (4287us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400940.086425:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 292 00000100:00100000:0.0:1786400940.091202:0:6615:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:0.0:1786400940.091215:0:6615:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d6ffd59b480, transno 4294967316 00000100:00100000:0.0:1786400940.091238:0:6615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd59a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6615:1873176872164224:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1786400940.092678:0:6615:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1786400940.092780:0:6615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdb85f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6615:1873176872164352:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1786400940.092846:0:6615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400940.092943:0:6615:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fe03e6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1786400940.093012:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872164352 00000100:00100000:3.0:1786400940.093020:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872164352 00000100:00100000:3.0:1786400940.093079:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1786400940.093124:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdb86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6615:x1873176872164352:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1786400940.093483:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdb86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6615:x1873176872164352:12345-0@lo:1000:mdt00_003.0 Request processed in 394us (635us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1786400940.093492:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1786400940.093575:0:6615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdb85f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6615:1873176872164352:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1786400940.093624:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e526 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.093634:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e526 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.093642:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e526 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.093648:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aa400 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400940.093652:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e526 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.093659:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e526 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.093676:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:0.0:1786400940.093679:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786400940.093684:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e526 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.093690:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e526 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.093722:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e462 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.093728:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e462 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.093733:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e462 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.093746:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138f400 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400940.093750:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e462 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.093755:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e462 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.093764:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fe06cbb00) 00010000:00010000:0.0:1786400940.093767:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786400940.093770:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e462 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.093776:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e462 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.093797:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e52d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.093812:0:6615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e47e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdcd expref: 21 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.093820:0:6615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e52d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.093846:0:6615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e47e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdcd expref: 21 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.093859:0:6615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e47e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdcd expref: 21 pid: 6615 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400940.093883:0:6615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdb84000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6615:1873176872164480:192.168.204.8@tcp:104: 00000100:00100000:0.0:1786400940.095142:0:6615:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fee1f3900 going to sleep for 11 seconds 00000100:00100000:0.0:1786400940.100574:0:6615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdb84000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6615:1873176872164480:192.168.204.8@tcp:104: 00010000:00010000:0.0:1786400940.100603:0:6615:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e52d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400940.102076:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400940.102893:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850153984 00000100:00100000:3.0:1786400940.102905:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850153984 00010000:00010000:3.0:1786400940.102949:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e47e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdcd expref: 22 pid: 6615 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400940.103158:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 73 00000100:00100000:3.0:1786400940.103169:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd59aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096c63d9-38b8-441b-8c71-343db25fe88a+22:2365:x1873176850153984:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786400940.103185:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400940.103192:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e47e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdcd expref: 22 pid: 6615 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.103207:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e47e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdcd expref: 22 pid: 6615 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.103241:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e47e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bdcd expref: 22 pid: 6615 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.103259:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fe06cbb00) 00010000:00010000:3.0:1786400940.103264:0:5774:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e52d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.103274:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e52d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.103292:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e52d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.103330:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400940.103396:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd59aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096c63d9-38b8-441b-8c71-343db25fe88a+21:2365:x1873176850153984:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 228us (1326us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400940.103404:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 73 00010000:00010000:1.0:1786400940.103669:0:6615:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e52d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.103678:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e52d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.103692:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e52d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.103707:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e52d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.103713:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e52d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.103719:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aa200 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400940.103723:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e52d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.103731:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e52d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.103741:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fe06cbb00) 00010000:00010000:1.0:1786400940.103744:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400940.103748:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e52d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.103753:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e52d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.103765:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1e51f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.103771:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1e51f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.103777:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1e51f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.103782:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aac00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400940.103791:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1e51f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.103798:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1e51f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.103806:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fe06cbb00) 00010000:00010000:1.0:1786400940.103809:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786400940.103811:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1e51f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.103823:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1e51f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400940.104479:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+20:11508:x1873176850153344:12345-192.168.204.8@tcp:57:lhsmtool_posix.0 Request processed in 31217us (31702us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1786400940.104489:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 186 00000020:00080000:1.0:1786400940.104495:0:6615:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1786400940.105859:0:11546:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786400940.105869:0:11546:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786400940.107538:0:11546:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1786400940.107550:0:11546:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786400940.109216:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400940.109488:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850154240 00000100:00100000:3.0:1786400940.109510:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850154240 00000100:00100000:3.0:1786400940.109573:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 50 00000100:00100000:3.0:1786400940.109584:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6d7d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+20:11508:x1873176850154240:12345-192.168.204.8@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1786400940.110952:0:5792:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1786400940.111255:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1786400940.111391:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e534 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.111408:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e534 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.111420:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e534 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.111429:0:5792:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e534 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.111436:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e534 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.111443:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e534 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.111468:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786400940.113484:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6d7d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+22:11508:x1873176850154240:12345-192.168.204.8@tcp:35:lhsmtool_posix.0 Request processed in 3889us (4263us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1786400940.113500:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 50 00000020:00080000:3.0:1786400940.113508:0:5792:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1786400940.115641:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786400940.115652:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e534 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.115663:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca091800 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:0.0:1786400940.115668:0:5776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e534 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.115678:0:5776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e534 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.115696:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9d6fc5599200) 00010000:00010000:0.0:1786400940.115699:0:5776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786400940.115703:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e534 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.115710:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e534 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.115752:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400940.115754:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400940.115756:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400940.271522:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873176872164736:0@lo:400:kworker.0 00000100:00100000:2.0:1786400940.271728:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400940.271788:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1786400940.271796:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:97b0324f-e214-4822-8711-e150ddac2a7e:3307:1873176872164608:0@lo:400:kworker.0 00000100:00100000:2.0:1786400940.271828:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400940.271862:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873176872164864:0@lo:400:kworker.0 00000100:00100000:2.0:1786400940.271887:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400940.271919:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786400940.271925:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873176872164992:0@lo:400:kworker.0 00000100:00100000:2.0:1786400940.271945:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400940.271974:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872164736 00000100:00100000:2.0:1786400940.271981:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872164736 00000100:00100000:2.0:1786400940.272035:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872164864 00000100:00100000:2.0:1786400940.272039:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872164864 00000100:00100000:2.0:1786400940.272063:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872164992 00000100:00100000:2.0:1786400940.272065:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872164992 00000100:00100000:2.0:1786400940.272081:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1786400940.272120:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873176872164736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400940.272184:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1873176872164736:12345-0@lo:400:kworker.0 Request processed in 66us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400940.272192:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1786400940.272214:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1786400940.272221:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873176872164864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400940.272258:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873176872164864:12345-0@lo:400:kworker.0 Request processed in 37us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400940.272264:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1786400940.272288:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1786400940.272294:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873176872164992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400940.272318:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873176872164992:12345-0@lo:400:kworker.0 Request processed in 25us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400940.272323:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1786400940.272351:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872164608 00000100:00100000:2.0:1786400940.272354:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872164608 00000100:00100000:2.0:1786400940.272376:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1786400940.272381:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4f7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+19:3307:x1873176872164608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400940.272413:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4f7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+19:3307:x1873176872164608:12345-0@lo:400:kworker.0 Request processed in 32us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400940.272418:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00080000:2.0:1786400940.272447:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786400940.272478:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:97b0324f-e214-4822-8711-e150ddac2a7e:3307:1873176872164608:0@lo:400:kworker.0 00000100:00100000:2.0:1786400940.272494:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1873176872164736:0@lo:400:kworker.0 00000100:00100000:0.0:1786400940.272495:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873176872164992:0@lo:400:kworker.0 00000100:00100000:0.0:1786400940.272516:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873176872164864:0@lo:400:kworker.0 00000100:00100000:2.0:1786400940.284765:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6ee0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872165120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786400940.284849:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400940.286421:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872165120 00000100:00100000:1.0:1786400940.286433:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872165120 00000100:00100000:1.0:1786400940.286500:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1786400940.286510:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fe902ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1873176872165120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786400940.286534:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1786400940.286605:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fe902ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1873176872165120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (1756us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400940.286613:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1786400940.286842:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6ee0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872165120:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1786400940.324912:0:12376:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786400940.324922:0:12376:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786400940.324962:0:12376:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1786400940.326210:0:12376:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786400940.516156:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400940.518539:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850154496 00000100:00100000:2.0:1786400940.518555:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850154496 00000100:00100000:2.0:1786400940.518637:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 187 00000100:00100000:2.0:1786400940.518648:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+22:11518:x1873176850154496:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:2.0:1786400940.518674:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400940.518694:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1baa00/0x5ccaaf4f3cb1e53b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6be05 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.518956:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba000/0x5ccaaf4f3cb1e542 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.518971:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba000/0x5ccaaf4f3cb1e542 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.518981:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba000/0x5ccaaf4f3cb1e542 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400940.518992:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1786400940.519206:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1baa00/0x5ccaaf4f3cb1e53b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be05 expref: 25 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.519231:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba000/0x5ccaaf4f3cb1e542 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be05 expref: 24 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.519241:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d6fc5599e00) 00010000:00010000:2.0:1786400940.519244:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1786400940.519247:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fee1ba000, rc 0) 00000100:00100000:2.0:1786400940.519320:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+24:11518:x1873176850154496:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 674us (3173us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1786400940.519328:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 187 00000100:00100000:2.0:1786400940.528420:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400940.528472:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850154624 00000100:00100000:2.0:1786400940.528482:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850154624 00000100:00100000:2.0:1786400940.528689:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 188 00000100:00100000:2.0:1786400940.528703:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+24:11518:x1873176850154624:12345-192.168.204.8@tcp:34:lfs.0 00010000:00010000:2.0:1786400940.528837:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb200/0x5ccaaf4f3cb1e550 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.528857:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb200/0x5ccaaf4f3cb1e550 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.528870:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb200/0x5ccaaf4f3cb1e550 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.528889:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba400/0x5ccaaf4f3cb1e557 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.528898:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba400/0x5ccaaf4f3cb1e557 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.528918:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba400/0x5ccaaf4f3cb1e557 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.529441:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e55e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.529452:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e55e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.529460:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e55e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786400940.529527:0:6615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e55e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.529540:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb200/0x5ccaaf4f3cb1e550 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.529546:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb200/0x5ccaaf4f3cb1e550 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.529552:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb200/0x5ccaaf4f3cb1e550 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.529557:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1bb200 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400940.529561:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb200/0x5ccaaf4f3cb1e550 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.529568:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb200/0x5ccaaf4f3cb1e550 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.529580:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d6fc5599e00) 00010000:00010000:2.0:1786400940.529590:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400940.529595:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb200/0x5ccaaf4f3cb1e550 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.529601:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb200/0x5ccaaf4f3cb1e550 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.529613:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba400/0x5ccaaf4f3cb1e557 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.529619:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba400/0x5ccaaf4f3cb1e557 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.529626:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba400/0x5ccaaf4f3cb1e557 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.529631:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1ba400 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400940.529633:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba400/0x5ccaaf4f3cb1e557 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.529639:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba400/0x5ccaaf4f3cb1e557 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.529647:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d6fd022ef00) 00010000:00010000:2.0:1786400940.529650:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400940.529653:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba400/0x5ccaaf4f3cb1e557 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.529658:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba400/0x5ccaaf4f3cb1e557 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.529677:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e55e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.529690:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e55e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.529696:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e55e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.529701:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1bba00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400940.529704:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e55e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.529711:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e55e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.529720:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fd022eb00) 00010000:00010000:2.0:1786400940.529722:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400940.529725:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e55e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.529731:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e55e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400940.529829:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+24:11518:x1873176850154624:12345-192.168.204.8@tcp:34:lfs.0 Request processed in 1128us (1420us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400940.529838:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 188 00000100:00100000:1.0:1786400940.578285:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400940.578625:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850154880 00000100:00100000:3.0:1786400940.578636:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850154880 00000100:00100000:3.0:1786400940.578748:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 189 00000100:00100000:3.0:1786400940.578761:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd59ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+24:11521:x1873176850154880:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:3.0:1786400940.578783:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400940.578819:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091c00/0x5ccaaf4f3cb1e565 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6be0c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.578898:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e56c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.578913:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e56c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.578926:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e56c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.578944:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091a00/0x5ccaaf4f3cb1e573 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.578952:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091a00/0x5ccaaf4f3cb1e573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.578959:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091a00/0x5ccaaf4f3cb1e573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.579916:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e57a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.579928:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e57a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.579942:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e57a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400940.579953:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1786400940.580363:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e56c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.580371:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e56c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.580378:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e56c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.580384:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca090e00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786400940.580389:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e56c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.580397:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e56c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.580411:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d6fc5599e00) 00010000:00010000:3.0:1786400940.580415:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400940.580420:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e56c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.580426:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e56c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.580439:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091a00/0x5ccaaf4f3cb1e573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.580445:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091a00/0x5ccaaf4f3cb1e573 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.580458:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091a00/0x5ccaaf4f3cb1e573 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.580463:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca091a00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786400940.580466:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091a00/0x5ccaaf4f3cb1e573 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.580472:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091a00/0x5ccaaf4f3cb1e573 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.580480:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d6fc5599700) 00010000:00010000:3.0:1786400940.580482:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400940.580485:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091a00/0x5ccaaf4f3cb1e573 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.580490:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091a00/0x5ccaaf4f3cb1e573 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.580555:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091c00/0x5ccaaf4f3cb1e565 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be0c expref: 27 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.580571:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e57a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be0c expref: 26 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.580579:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fc5599900) 00010000:00010000:3.0:1786400940.580581:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786400940.580583:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca090c00, rc 0) 00000100:00100000:3.0:1786400940.580649:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd59ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+26:11521:x1873176850154880:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 1891us (2374us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1786400940.580667:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 189 00000100:00100000:3.0:1786400940.588447:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400940.588504:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850155008 00000100:00100000:1.0:1786400940.588515:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850155008 00000100:00100000:1.0:1786400940.588580:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 190 00000100:00100000:1.0:1786400940.588603:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+26:11521:x1873176850155008:12345-192.168.204.8@tcp:54:lfs.0 00010000:00010000:1.0:1786400940.588674:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e588 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.588689:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e588 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.588700:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e588 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.588728:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e588 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.588735:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e588 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.588741:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e588 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.588747:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138e600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400940.588751:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e588 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.588758:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e588 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.588770:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fc5599900) 00010000:00010000:1.0:1786400940.588773:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1786400940.588777:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e588 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.588792:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e588 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400940.588874:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+26:11521:x1873176850155008:12345-192.168.204.8@tcp:54:lfs.0 Request processed in 284us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400940.588894:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 190 00000100:00100000:3.0:1786400940.594557:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400940.595707:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850155264 00000100:00100000:1.0:1786400940.595720:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850155264 00000100:00100000:1.0:1786400940.595954:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 51 00000100:00100000:1.0:1786400940.595981:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+26:11521:x1873176850155264:12345-192.168.204.8@tcp:35:lfs.0 00000100:00100000:1.0:1786400940.596293:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+27:11521:x1873176850155264:12345-192.168.204.8@tcp:35:lfs.0 Request processed in 327us (1743us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1786400940.596302:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 51 00000100:00100000:3.0:1786400940.679767:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400940.679852:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850155520 00000100:00100000:1.0:1786400940.679862:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850155520 00000100:00100000:1.0:1786400940.679929:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 191 00000100:00100000:1.0:1786400940.679939:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+27:11056:x1873176850155520:12345-192.168.204.8@tcp:101:bash.0 00010000:00010000:1.0:1786400940.679965:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400940.679987:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e58f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6be13 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.680381:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e596 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.680399:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e57a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be0c expref: 28 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.680423:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e596 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.680459:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e57a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be0c expref: 28 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.680473:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e57a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be0c expref: 28 pid: 5790 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400940.680487:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd598380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5788:1873176872165248:192.168.204.8@tcp:104: 00000100:00100000:1.0:1786400940.680599:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc34ec3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1786400940.688380:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400940.688416:0:8369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850155648 00000100:00100000:3.0:1786400940.688425:0:8369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850155648 00010000:00010000:3.0:1786400940.688466:0:8369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e57a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be0c expref: 29 pid: 5790 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400940.688501:0:8369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 74 00000100:00100000:3.0:1786400940.688511:0:8369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+29:2364:x1873176850155648:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786400940.688537:0:8369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400940.688546:0:8369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e57a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be0c expref: 29 pid: 5790 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.688559:0:8369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e57a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be0c expref: 29 pid: 5790 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.688586:0:8369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fc5599900) 00010000:00010000:3.0:1786400940.688592:0:8369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e596 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.688603:0:8369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e596 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.688611:0:8369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e596 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.688640:0:8369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400940.688695:0:8369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+29:2364:x1873176850155648:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 184us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400940.688704:0:8369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 74 00010000:00010000:3.0:1786400940.688842:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e57a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be0c expref: 28 pid: 5790 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400940.688856:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd598380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5788:1873176872165248:192.168.204.8@tcp:104: 00010000:00010000:3.0:1786400940.688878:0:5788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e596 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.688888:0:5788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e596 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.688893:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e596 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400940.688911:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1786400940.689068:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e58f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be13 expref: 29 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.689125:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e596 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be13 expref: 28 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.689133:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fc5599900) 00010000:00010000:3.0:1786400940.689137:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1786400940.689139:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138f800, rc 0) 00000100:00100000:3.0:1786400940.689181:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+28:11056:x1873176850155520:12345-192.168.204.8@tcp:101:bash.0 Request processed in 9243us (9424us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1786400940.689196:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 191 00000100:00100000:3.0:1786400940.696407:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400940.697869:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850155904 00000100:00100000:2.0:1786400940.697883:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850155904 00000100:00100000:2.0:1786400940.697952:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 192 00000100:00100000:2.0:1786400940.697965:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+28:11056:x1873176850155904:12345-192.168.204.8@tcp:36:bash.0 00010000:00010000:2.0:1786400940.701369:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba400/0x5ccaaf4f3cb1e5a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.701407:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba400/0x5ccaaf4f3cb1e5a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.701427:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba400/0x5ccaaf4f3cb1e5a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786400940.701500:0:6615:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1786400940.701530:0:6615:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000088d61dec reply state 00000000722de718 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba400/0x5ccaaf4f3cb1e5a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400940.701540:0:6615:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1786400940.701595:0:6615:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1786400940.701848:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+32:11056:x1873176850155904:12345-192.168.204.8@tcp:36:bash.0 Request processed in 3881us (5445us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1786400940.701857:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 192 00000020:00080000:2.0:1786400940.701863:0:6615:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1786400940.706430:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba400/0x5ccaaf4f3cb1e5a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.706451:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba400/0x5ccaaf4f3cb1e5a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.706458:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba400/0x5ccaaf4f3cb1e5a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.706463:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1ba400 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400940.706468:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba400/0x5ccaaf4f3cb1e5a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.706475:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba400/0x5ccaaf4f3cb1e5a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.706492:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fc5599900) 00010000:00010000:1.0:1786400940.706495:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400940.706515:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba400/0x5ccaaf4f3cb1e5a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.706521:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba400/0x5ccaaf4f3cb1e5a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400940.707650:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400940.707914:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850156032 00000100:00100000:1.0:1786400940.707925:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850156032 00000100:00100000:1.0:1786400940.707977:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 193 00000100:00100000:1.0:1786400940.707986:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+31:11056:x1873176850156032:12345-192.168.204.8@tcp:101:bash.0 00010000:00010000:1.0:1786400940.708012:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400940.708031:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e5ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6be1a expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.708850:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e5ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be1a expref: 32 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.708870:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e5ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be1a expref: 32 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.708898:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fc5599900) 00010000:00010000:1.0:1786400940.708901:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786400940.708905:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138e600, rc 0) 00000100:00100000:1.0:1786400940.709011:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+32:11056:x1873176850156032:12345-192.168.204.8@tcp:101:bash.0 Request processed in 1024us (1367us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400940.709019:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 193 00000100:00100000:0.0:1786400940.719433:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400940.719654:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850156160 00000100:00100000:3.0:1786400940.719665:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850156160 00000100:00100000:3.0:1786400940.719848:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 59 00000100:00100000:3.0:1786400940.719860:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdb84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+7:11056:x1873176850156160:12345-192.168.204.8@tcp:101:bash.0 00010000:00010000:3.0:1786400940.719877:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400940.719901:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1a483a6/0x5ccaaf4f3cb1e5b2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6be21 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786400940.720169:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a7a50a9, atime: 0x6a7a50a7, ctime: 0x6a7a50a9, blocks: 0xb 00010000:00010000:3.0:1786400940.720195:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=393s v=(0 0) 00010000:00010000:3.0:1786400940.720201:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400940.720209:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1a483a6/0x5ccaaf4f3cb1e5b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be21 expref: 8 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.720227:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b1a483a6/0x5ccaaf4f3cb1e5b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be21 expref: 8 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400940.720594:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca090c00, rc 0) 00000100:00100000:0.0:1786400940.720844:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdb84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+8:11056:x1873176850156160:12345-192.168.204.8@tcp:101:bash.0 Request processed in 984us (1421us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400940.720854:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 59 00000100:00100000:0.0:1786400940.723716:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400940.723803:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850156288 00000100:00100000:2.0:1786400940.723813:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850156288 00002000:00010000:2.0:1786400940.723853:0:6596:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1786400940.723858:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ffdb86a00 with x1873176850156288 ext(0->18446744073709551615) 00002000:00010000:2.0:1786400940.723869:0:6596:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d6ffdb86a00. 00000100:00100000:2.0:1786400940.723938:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 6 00000100:00100000:2.0:1786400940.723949:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdb86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:096c63d9-38b8-441b-8c71-343db25fe88a+8:2363:x1873176850156288:12345-192.168.204.8@tcp:10:bash.0 00002000:00010000:2.0:1786400940.724422:0:6596:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1786400940.724426:0:6596:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1786400937 -> 1786400939 00002000:00010000:2.0:1786400940.724429:0:6596:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1786400935 -> 1786400935 00002000:00010000:2.0:1786400940.724431:0:6596:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1786400937 -> 1786400939 00002000:00010000:2.0:1786400940.724433:0:6596:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1786400940.724516:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdb86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:096c63d9-38b8-441b-8c71-343db25fe88a+9:2363:x1873176850156288:12345-192.168.204.8@tcp:10:bash.0 Request processed in 567us (808us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1786400940.724524:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 6 00002000:00010000:2.0:1786400940.724528:0:6596:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1786400940.724530:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ffdb86a00 with x1873176850156288 ext(0->18446744073709551615) 00002000:00010000:2.0:1786400940.724536:0:6596:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d6ffdb86a00. 00000100:00100000:3.0:1786400940.919050:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400940.919205:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850156416 00000100:00100000:0.0:1786400940.919215:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850156416 00000100:00100000:0.0:1786400940.919348:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 194 00000100:00100000:0.0:1786400940.919359:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+32:11535:x1873176850156416:12345-192.168.204.8@tcp:34:lfs.0 00010000:00010000:0.0:1786400940.919437:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e5b9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.919455:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e5b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.919468:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e5b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.919483:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e5c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.919490:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.919511:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.919809:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e5c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.919819:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.919827:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786400940.919900:0:5789:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.919911:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e5b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.919918:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e5b9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.919924:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e5b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.919929:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aa600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400940.919933:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e5b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.919940:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e5b9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.919952:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d6fc5599e00) 00010000:00010000:0.0:1786400940.919962:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400940.919966:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e5b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.919971:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e5b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.919984:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.919989:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e5c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.919994:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e5c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.919998:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5ab200 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400940.920001:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e5c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.920006:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e5c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.920013:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d6fc90cd300) 00010000:00010000:0.0:1786400940.920016:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400940.920018:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e5c0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.920024:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e5c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.920039:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.920051:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e5c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.920056:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e5c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.920061:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aaa00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400940.920064:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e5c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.920069:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e5c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.920077:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fc5599900) 00010000:00010000:0.0:1786400940.920135:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400940.920138:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e5c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400940.920144:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e5c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400940.920226:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+32:11535:x1873176850156416:12345-192.168.204.8@tcp:34:lfs.0 Request processed in 867us (1184us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400940.920234:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 194 00010000:00010000:3.0:1786400940.974360:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400940.983754:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400940.984354:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850156672 00000100:00100000:1.0:1786400940.984366:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850156672 00000100:00100000:1.0:1786400940.984482:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 195 00000100:00100000:1.0:1786400940.984506:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+32:11538:x1873176850156672:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:1.0:1786400940.984528:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400940.984551:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e5ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6be28 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.984624:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e5d5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.984639:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e5d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.984651:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e5d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.984665:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e5dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.984673:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e5dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.984679:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e5dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.985006:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e5e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.985015:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e5e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.985021:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e5e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400940.985042:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1786400940.985185:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e5d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.985193:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e5d5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.985201:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e5d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.985207:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138f200 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400940.985212:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e5d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.985220:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e5d5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.985232:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d6fc5599e00) 00010000:00010000:1.0:1786400940.985245:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400940.985250:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e5d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.985256:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e5d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.985269:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e5dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.985275:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e5dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.985291:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e5dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.985296:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138fa00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400940.985299:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e5dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.985305:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e5dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.985313:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d6fe06cbb00) 00010000:00010000:1.0:1786400940.985315:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400940.985318:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e5dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.985324:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e5dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.985367:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e5ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be28 expref: 35 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.985382:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e5e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be28 expref: 34 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400940.985388:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fc5599900) 00010000:00010000:1.0:1786400940.985390:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1786400940.985392:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138f400, rc 0) 00000100:00100000:1.0:1786400940.985478:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+34:11538:x1873176850156672:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 974us (1734us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1786400940.985494:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 195 00000100:00100000:3.0:1786400940.995398:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400940.995845:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850156800 00000100:00100000:2.0:1786400940.995855:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850156800 00000100:00100000:2.0:1786400940.995922:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 196 00000100:00100000:2.0:1786400940.995932:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+34:11538:x1873176850156800:12345-192.168.204.8@tcp:54:lfs.0 00010000:00010000:2.0:1786400940.996007:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb200/0x5ccaaf4f3cb1e5f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.996024:0:6615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e596 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be13 expref: 34 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.996033:0:6615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb200/0x5ccaaf4f3cb1e5f1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.996067:0:6615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e596 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be13 expref: 34 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400940.996113:0:6615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e596 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be13 expref: 34 pid: 5788 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400940.996129:0:6615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f64380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6615:1873176872165376:192.168.204.8@tcp:104: 00000100:00100000:2.0:1786400940.997041:0:6615:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec59840c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786400941.004270:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400941.004397:0:6615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f64380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6615:1873176872165376:192.168.204.8@tcp:104: 00010000:00010000:2.0:1786400941.004438:0:6615:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb200/0x5ccaaf4f3cb1e5f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400941.004636:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850157056 00000100:00100000:3.0:1786400941.004651:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850157056 00000100:00100000:3.0:1786400941.004714:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 52 00000100:00100000:3.0:1786400941.004724:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdb87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+35:5577:x1873176850157056:12345-192.168.204.8@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1786400941.005607:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdb87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+36:5577:x1873176850157056:12345-192.168.204.8@tcp:35:ldlm_bl.0 Request processed in 880us (1343us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1786400941.005619:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 52 00000100:00100000:3.0:1786400941.010579:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400941.011574:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850157184 00000100:00100000:1.0:1786400941.011587:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850157184 00010000:00010000:1.0:1786400941.011637:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e596 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be13 expref: 36 pid: 5788 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400941.011679:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 75 00000100:00100000:1.0:1786400941.011689:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc458ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096c63d9-38b8-441b-8c71-343db25fe88a+36:2365:x1873176850157184:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400941.011706:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400941.011713:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e596 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be13 expref: 36 pid: 5788 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.011725:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e596 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be13 expref: 36 pid: 5788 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.011747:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e596 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be13 expref: 36 pid: 5788 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.011767:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fc5599900) 00010000:00010000:1.0:1786400941.011772:0:5774:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb200/0x5ccaaf4f3cb1e5f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.011783:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb200/0x5ccaaf4f3cb1e5f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.011790:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb200/0x5ccaaf4f3cb1e5f1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.011851:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400941.011924:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc458ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096c63d9-38b8-441b-8c71-343db25fe88a+35:2365:x1873176850157184:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 236us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400941.011932:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 75 00010000:00010000:2.0:1786400941.012213:0:6615:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb200/0x5ccaaf4f3cb1e5f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.012343:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb200/0x5ccaaf4f3cb1e5f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.012379:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb200/0x5ccaaf4f3cb1e5f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.012387:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb200/0x5ccaaf4f3cb1e5f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.012394:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb200/0x5ccaaf4f3cb1e5f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.012399:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1bb200 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400941.012403:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb200/0x5ccaaf4f3cb1e5f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.012409:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb200/0x5ccaaf4f3cb1e5f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.012419:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fc5599900) 00010000:00010000:2.0:1786400941.012421:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786400941.012425:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb200/0x5ccaaf4f3cb1e5f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.012431:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb200/0x5ccaaf4f3cb1e5f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400941.012486:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd570e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+34:11538:x1873176850156800:12345-192.168.204.8@tcp:54:lfs.0 Request processed in 16555us (17165us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400941.012495:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 196 00000100:00100000:3.0:1786400941.019128:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400941.019317:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850157440 00000100:00100000:1.0:1786400941.019328:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850157440 00000100:00100000:1.0:1786400941.019375:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 53 00000100:00100000:1.0:1786400941.019386:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc34c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+34:11538:x1873176850157440:12345-192.168.204.8@tcp:35:lfs.0 00000100:00100000:1.0:1786400941.019630:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc34c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+35:11538:x1873176850157440:12345-192.168.204.8@tcp:35:lfs.0 Request processed in 244us (510us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1786400941.019638:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 53 00000100:00100000:3.0:1786400941.145083:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400941.145952:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850157696 00000100:00100000:1.0:1786400941.145964:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850157696 00000100:00100000:1.0:1786400941.146031:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 197 00000100:00100000:1.0:1786400941.146042:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc34c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+35:11550:x1873176850157696:12345-192.168.204.8@tcp:101:cat.0 00010000:00010000:1.0:1786400941.146066:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400941.146121:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e5f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6be2f expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.146202:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e5ff lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.146217:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e5ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.146228:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e5ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.146263:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e606 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.146271:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e606 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.146278:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e606 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.146623:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e60d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.146632:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e60d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.146639:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e60d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400941.146649:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1786400941.146743:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e5ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.146751:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e5ff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.146758:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e5ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.146764:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138ee00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400941.146768:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e5ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.146786:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e5ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.146816:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d6fc5599e00) 00010000:00010000:1.0:1786400941.146819:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400941.146824:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e5ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.146830:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e5ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.146843:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e606 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.146849:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e606 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.146854:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e606 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.146859:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138fa00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400941.146862:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e606 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.146868:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e606 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.146874:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d6fe06cbb00) 00010000:00010000:1.0:1786400941.146877:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400941.146879:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e606 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.146895:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e606 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.146942:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e5f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be2f expref: 38 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.146957:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e60d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be2f expref: 37 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.146963:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fc5599900) 00010000:00010000:1.0:1786400941.146965:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786400941.146968:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138f200, rc 0) 00000100:00100000:1.0:1786400941.147051:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc34c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+37:11550:x1873176850157696:12345-192.168.204.8@tcp:101:cat.0 Request processed in 1011us (1988us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1786400941.147060:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 197 00000100:00100000:3.0:1786400941.157925:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400941.158932:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850157952 00000100:00100000:1.0:1786400941.158945:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850157952 00000100:00100000:1.0:1786400941.159067:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 54 00000100:00100000:1.0:1786400941.159123:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc34c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+37:11550:x1873176850157952:12345-192.168.204.8@tcp:35:cat.0 00000100:00100000:1.0:1786400941.159371:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc34c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+38:11550:x1873176850157952:12345-192.168.204.8@tcp:35:cat.0 Request processed in 294us (1454us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1786400941.159379:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 54 00000100:00100000:0.0:1786400941.206433:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400941.207264:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850158208 00000100:00100000:1.0:1786400941.207275:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850158208 00000100:00100000:1.0:1786400941.207334:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 198 00000100:00100000:1.0:1786400941.207344:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdb87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+38:11551:x1873176850158208:12345-192.168.204.8@tcp:36:rm.0 00010000:00010000:1.0:1786400941.207421:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1786400941.207452:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e60d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be2f expref: 38 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.207474:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e5e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be28 expref: 37 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.207486:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e5ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be1a expref: 36 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.207496:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fc5599900) 00010000:00010000:1.0:1786400941.207506:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786400941.207528:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e61b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.207542:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e61b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.207551:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e61b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.207565:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e622 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.207572:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e622 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.207577:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e622 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.207907:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e629 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.207916:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e629 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.207922:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e629 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786400941.208591:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:1.0:1786400941.208600:0:5789:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 393609513426ns, next at 394609511359ns, rc = 0 00010000:00010000:1.0:1786400941.208656:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1e630 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.208669:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1e630 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.208679:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1e630 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.208688:0:5789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1e630 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.208695:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1e630 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.208701:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1e630 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.208735:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786400941.208755:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e629 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.208769:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e629 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.208775:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e629 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.208782:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138ee00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400941.208787:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e629 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.208794:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e629 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.208805:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fe06cb200) 00010000:00010000:1.0:1786400941.208807:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1786400941.208810:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e629 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.208815:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e629 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.208833:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e61b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.208838:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e61b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.208843:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e61b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.208847:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138f800 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400941.208857:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e61b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.208864:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e61b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.208871:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d6fc5599e00) 00010000:00010000:1.0:1786400941.208873:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400941.208876:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e61b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.208882:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e61b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786400941.208893:0:5789:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000070615d47 reply state 00000000f43d0a9f transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e622 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400941.208901:0:5789:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786400941.208988:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdb87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+37:11551:x1873176850158208:12345-192.168.204.8@tcp:36:rm.0 Request processed in 1641us (2562us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1786400941.208996:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 198 00010000:00010000:3.0:1786400941.212212:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786400941.212227:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1e630 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.212239:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138ea00 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:3.0:1786400941.212245:0:5776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1e630 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.212254:0:5776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1e630 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.212272:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9d6fe06cb200) 00010000:00010000:3.0:1786400941.212275:0:5776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1786400941.212280:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1e630 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.212286:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1e630 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.212314:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400941.212333:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400941.212335:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400941.215312:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e622 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.215330:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e622 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.215338:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e622 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.215344:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138fa00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400941.215349:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e622 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.215357:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e622 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.215374:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d6fe06cbb00) 00010000:00010000:2.0:1786400941.215377:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400941.215381:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e622 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.215388:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e622 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400941.301153:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400941.302009:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850158464 00000100:00100000:1.0:1786400941.302021:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850158464 00000100:00100000:1.0:1786400941.302163:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 199 00000100:00100000:1.0:1786400941.302175:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+36:11557:x1873176850158464:12345-192.168.204.8@tcp:101:bash.0 00010000:00010000:1.0:1786400941.302201:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400941.302223:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e637 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6be36 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.302358:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e63e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.302387:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e63e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.302400:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e63e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.302418:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e645 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.302426:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e645 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.302432:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e645 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786400941.303027:0:5790:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1786400941.303238:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e64c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.303249:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e64c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.303258:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e64c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.303293:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e63e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.303300:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e63e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.303306:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e63e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.303319:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138ee00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400941.303323:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e63e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.303330:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e63e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.303343:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d6fc5599e00) 00010000:00010000:1.0:1786400941.303346:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400941.303350:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e63e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.303356:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e63e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786400941.303371:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000506bb698 reply state 00000000facbe050 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e645 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400941.303380:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1786400941.303411:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e637 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be36 expref: 39 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.303427:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e64c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be36 expref: 38 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.303434:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d6fe06cbf00) 00010000:00010000:1.0:1786400941.303436:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786400941.303438:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138f400, rc 0) 00000100:00100000:1.0:1786400941.303527:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+39:11557:x1873176850158464:12345-192.168.204.8@tcp:101:bash.0 Request processed in 1353us (2385us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1786400941.303540:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 199 00010000:00010000:1.0:1786400941.307698:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e645 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.307716:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e645 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.307725:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e645 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.307732:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138e600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400941.307737:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e645 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.307746:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e645 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.307765:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d6fe06cbe00) 00010000:00010000:1.0:1786400941.307768:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400941.307773:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e645 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.307780:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e645 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400941.312452:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400941.313912:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850158592 00000100:00100000:3.0:1786400941.313925:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850158592 00000100:00100000:3.0:1786400941.313993:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 60 00000100:00100000:3.0:1786400941.314003:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd003800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+7:2364:x1873176850158592:12345-192.168.204.8@tcp:101:bash.0 00010000:00010000:3.0:1786400941.314021:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400941.314044:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003de1132e/0x5ccaaf4f3cb1e65a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6be3d expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786400941.314079:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786400941.314364:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=393s v=(0 0) 00010000:00010000:3.0:1786400941.314370:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400941.314380:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003de1132e/0x5ccaaf4f3cb1e65a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be3d expref: 8 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.314398:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003de1132e/0x5ccaaf4f3cb1e65a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be3d expref: 8 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.314412:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca091c00, rc 0) 00000100:00100000:3.0:1786400941.314947:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd003800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+8:2364:x1873176850158592:12345-192.168.204.8@tcp:101:bash.0 Request processed in 943us (2504us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400941.314955:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 60 00000100:00100000:3.0:1786400941.321924:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400941.322056:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850158720 00000100:00100000:1.0:1786400941.322067:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850158720 00000100:00100000:1.0:1786400941.322198:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 61 00000100:00100000:1.0:1786400941.322210:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc34c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+8:11557:x1873176850158720:12345-192.168.204.8@tcp:101:bash.0 00010000:00010000:1.0:1786400941.322230:0:6593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400941.322262:0:6593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000945ba3c4/0x5ccaaf4f3cb1e661 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6be44 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.322296:0:6593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003de1132e/0x5ccaaf4f3cb1e65a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be3d expref: 9 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.322305:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786400941.322309:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786400941.322314:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000945ba3c4/0x5ccaaf4f3cb1e661 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be44 expref: 9 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.322349:0:6593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003de1132e/0x5ccaaf4f3cb1e65a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be3d expref: 9 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.322365:0:6593:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003de1132e/0x5ccaaf4f3cb1e65a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be3d expref: 9 pid: 6590 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400941.322383:0:6593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd599180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6593:1873176872165504:192.168.204.8@tcp:104: 00000100:00100000:1.0:1786400941.322487:0:6593:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc924fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1786400941.330200:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400941.330385:0:6593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd599180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6593:1873176872165504:192.168.204.8@tcp:104: 00010000:00010000:1.0:1786400941.330421:0:6593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000945ba3c4/0x5ccaaf4f3cb1e661 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be44 expref: 9 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.330444:0:6593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138e600, rc 0) 00000100:00100000:1.0:1786400941.330518:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc34c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+9:11557:x1873176850158720:12345-192.168.204.8@tcp:101:bash.0 Request processed in 8311us (8603us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400941.330547:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 61 00000100:00100000:3.0:1786400941.330971:0:8369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850158848 00000100:00100000:3.0:1786400941.330979:0:8369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850158848 00010000:00010000:3.0:1786400941.331011:0:8369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003de1132e/0x5ccaaf4f3cb1e65a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be3d expref: 9 pid: 6590 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400941.331134:0:8369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 76 00000100:00100000:3.0:1786400941.331144:0:8369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd000000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+9:2365:x1873176850158848:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786400941.331159:0:8369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400941.331183:0:8369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003de1132e/0x5ccaaf4f3cb1e65a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be3d expref: 9 pid: 6590 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.331197:0:8369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003de1132e/0x5ccaaf4f3cb1e65a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be3d expref: 9 pid: 6590 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.331224:0:8369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003de1132e/0x5ccaaf4f3cb1e65a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be3d expref: 9 pid: 6590 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.331239:0:8369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400941.331244:0:8369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400941.331252:0:8369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000945ba3c4/0x5ccaaf4f3cb1e661 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be44 expref: 8 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.331262:0:8369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000945ba3c4/0x5ccaaf4f3cb1e661 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be44 expref: 8 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.331296:0:8369:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000945ba3c4/0x5ccaaf4f3cb1e661 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be44 expref: 8 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400941.331312:0:8369:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc34c0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8369:1873176872165632:192.168.204.8@tcp:105: 00000100:00100000:3.0:1786400941.331380:0:8369:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d7000f21d80 going to sleep for 11 seconds 00000100:00100000:3.0:1786400941.336383:0:8369:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc34c0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8369:1873176872165632:192.168.204.8@tcp:105: 00010000:00010000:3.0:1786400941.336412:0:8369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400941.336656:0:8369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd000000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+8:2365:x1873176850158848:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 5511us (6463us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400941.336667:0:8369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 76 00000100:00100000:0.0:1786400941.340687:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400941.340884:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850159104 00000100:00100000:3.0:1786400941.340893:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850159104 00000100:00100000:3.0:1786400941.341053:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 55 00000100:00100000:3.0:1786400941.341064:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+38:11557:x1873176850159104:12345-192.168.204.8@tcp:35:bash.0 00000100:00100000:3.0:1786400941.341428:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+39:11557:x1873176850159104:12345-192.168.204.8@tcp:35:bash.0 Request processed in 365us (750us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1786400941.341436:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 55 00000100:00100000:0.0:1786400941.524453:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400941.524650:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850159232 00000100:00100000:1.0:1786400941.524660:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850159232 00000100:00100000:1.0:1786400941.524727:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 200 00000100:00100000:1.0:1786400941.524738:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+39:11573:x1873176850159232:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:1.0:1786400941.524762:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400941.524783:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e668 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6be4b expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.524851:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e66f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.524865:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e66f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.524875:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e66f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400941.524936:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1786400941.524941:0:5789:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1786400941.524965:0:5789:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e66f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.524991:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e668 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be4b expref: 41 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.525010:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e66f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be4b expref: 40 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.525037:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d6fc5599e00) 00010000:00010000:1.0:1786400941.525041:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786400941.525044:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138ee00, rc 0) 00000100:00100000:1.0:1786400941.525177:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+40:11573:x1873176850159232:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 440us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400941.525184:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 200 00000100:00100000:0.0:1786400941.533456:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400941.533688:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850159488 00000100:00100000:3.0:1786400941.533700:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850159488 00000100:00100000:3.0:1786400941.533774:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 201 00000100:00100000:3.0:1786400941.533784:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+40:11573:x1873176850159488:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:3.0:1786400941.534029:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400941.534051:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091c00/0x5ccaaf4f3cb1e676 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6be52 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.534190:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091a00/0x5ccaaf4f3cb1e67d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.534203:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091a00/0x5ccaaf4f3cb1e67d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.534227:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091a00/0x5ccaaf4f3cb1e67d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400941.534239:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1786400941.534382:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091c00/0x5ccaaf4f3cb1e676 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be52 expref: 43 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.534401:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091a00/0x5ccaaf4f3cb1e67d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be52 expref: 42 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.534410:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d6fe06cbf00) 00010000:00010000:3.0:1786400941.534413:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786400941.534416:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca091a00, rc 0) 00000100:00100000:3.0:1786400941.534728:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+42:11573:x1873176850159488:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 944us (1280us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1786400941.534737:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 201 00000100:00100000:3.0:1786400941.540185:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400941.540832:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850159744 00000100:00100000:1.0:1786400941.540844:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850159744 00000100:00100000:1.0:1786400941.540909:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 202 00000100:00100000:1.0:1786400941.540919:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc34c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+42:11573:x1873176850159744:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:1.0:1786400941.540944:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400941.541438:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e68b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6be59 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.541567:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e692 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.541582:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e692 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.541593:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e692 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786400941.541606:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1786400941.541746:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e68b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be59 expref: 45 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.541778:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e692 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be59 expref: 44 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.542686:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d6fe06cbf00) 00010000:00010000:1.0:1786400941.542693:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1786400941.542697:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138f200, rc 0) 00000100:00100000:1.0:1786400941.543126:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc34c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+44:11573:x1873176850159744:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 2203us (2946us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1786400941.543136:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 202 00000100:00100000:0.0:1786400941.545549:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400941.545995:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850159872 00000100:00100000:1.0:1786400941.546006:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850159872 00000100:00100000:1.0:1786400941.546437:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 15 00000100:00100000:1.0:1786400941.546450:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096c63d9-38b8-441b-8c71-343db25fe88a+44:2364:x1873176850159872:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400941.546467:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400941.546494:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091a00/0x5ccaaf4f3cb1e67d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be52 expref: 44 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.546529:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d6fe06cbf00) 00010000:00010000:1.0:1786400941.546535:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400941.546601:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096c63d9-38b8-441b-8c71-343db25fe88a+43:2364:x1873176850159872:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 154us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400941.546609:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 15 00000100:00100000:0.0:1786400941.559145:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400941.559448:0:11770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850160000 00000100:00100000:2.0:1786400941.559458:0:11770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850160000 00000100:00100000:2.0:1786400941.559521:0:11770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 62 00000100:00100000:2.0:1786400941.559547:0:11770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4908a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:096c63d9-38b8-441b-8c71-343db25fe88a+8:2362:x1873176850160000:12345-192.168.204.8@tcp:1:lfs.0 00010000:00010000:2.0:1786400941.559596:0:11770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d0f1cfb/0x5ccaaf4f3cb1e6a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.559616:0:11770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000945ba3c4/0x5ccaaf4f3cb1e661 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be44 expref: 8 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.559626:0:11770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400941.559630:0:11770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786400941.559635:0:11770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d0f1cfb/0x5ccaaf4f3cb1e6a0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.559671:0:11770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000945ba3c4/0x5ccaaf4f3cb1e661 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be44 expref: 8 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.559685:0:11770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000945ba3c4/0x5ccaaf4f3cb1e661 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be44 expref: 8 pid: 6593 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400941.559699:0:11770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f64380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11770:1873176872165760:192.168.204.8@tcp:104: 00000100:00100000:2.0:1786400941.560188:0:11770:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec59840c0 going to sleep for 11 seconds 00000100:00100000:2.0:1786400941.563455:0:11770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f64380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11770:1873176872165760:192.168.204.8@tcp:104: 00010000:00010000:2.0:1786400941.563487:0:11770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006d0f1cfb/0x5ccaaf4f3cb1e6a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400941.566443:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400941.567034:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850160128 00000100:00100000:1.0:1786400941.567046:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850160128 00002000:00100000:1.0:1786400941.567344:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9d6fc490b480 x1873176850160128/t0(0) o4->096c63d9-38b8-441b-8c71-343db25fe88a@192.168.204.8@tcp:737/0 lens 504/0 e 0 to 0 dl 1786400952 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786400941.567369:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6fc490b480 with x1873176850160128 ext(0->8) 00010000:00010000:1.0:1786400941.567380:0:6598:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000945ba3c4/0x5ccaaf4f3cb1e661 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be44 expref: 9 pid: 6593 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.567396:0:6598:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000945ba3c4/0x5ccaaf4f3cb1e661 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be44 expref: 9 pid: 6593 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786400941.567404:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9d6fc490b480 00000100:00100000:1.0:1786400941.567536:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 3 00000100:00100000:1.0:1786400941.567546:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc490b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:096c63d9-38b8-441b-8c71-343db25fe88a+9:2365:x1873176850160128:12345-192.168.204.8@tcp:4:lfs.0 00000100:00100000:1.0:1786400941.568334:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc490b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:096c63d9-38b8-441b-8c71-343db25fe88a+11:2365:x1873176850160128:12345-192.168.204.8@tcp:4:lfs.0 Request processed in 787us (1899us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1786400941.568345:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 3 00002000:00100000:1.0:1786400941.568353:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9d6fc490b480 x1873176850160128/t4294967308(0) o4->096c63d9-38b8-441b-8c71-343db25fe88a@192.168.204.8@tcp:737/0 lens 504/448 e 0 to 0 dl 1786400952 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1786400941.568362:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6fc490b480 with x1873176850160128 ext(0->8) 00010000:00010000:1.0:1786400941.568368:0:6598:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000945ba3c4/0x5ccaaf4f3cb1e661 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be44 expref: 11 pid: 6593 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.568382:0:6598:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000945ba3c4/0x5ccaaf4f3cb1e661 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be44 expref: 11 pid: 6593 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1786400941.568388:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9d6fc490b480 00000100:00100000:3.0:1786400941.572486:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400941.573078:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850160256 00000100:00100000:1.0:1786400941.573143:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850160256 00010000:00010000:1.0:1786400941.573184:0:5773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000945ba3c4/0x5ccaaf4f3cb1e661 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be44 expref: 11 pid: 6593 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400941.573393:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 77 00000100:00100000:1.0:1786400941.573404:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4987b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096c63d9-38b8-441b-8c71-343db25fe88a+11:2364:x1873176850160256:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400941.573421:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1786400941.573443:0:5773:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1786400941.573446:0:5773:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1786400940 00002000:00010000:1.0:1786400941.573448:0:5773:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1786400940 00002000:00010000:1.0:1786400941.573450:0:5773:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1786400940 00010000:00010000:1.0:1786400941.573457:0:5773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000945ba3c4/0x5ccaaf4f3cb1e661 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be44 expref: 11 pid: 6593 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.573471:0:5773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000945ba3c4/0x5ccaaf4f3cb1e661 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be44 expref: 11 pid: 6593 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.573495:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000945ba3c4/0x5ccaaf4f3cb1e661 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be44 expref: 11 pid: 6593 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.573765:0:5773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786400941.573770:0:5773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786400941.573777:0:5773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006d0f1cfb/0x5ccaaf4f3cb1e6a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.573789:0:5773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d0f1cfb/0x5ccaaf4f3cb1e6a0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.573843:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400941.573907:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4987b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096c63d9-38b8-441b-8c71-343db25fe88a+10:2364:x1873176850160256:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 505us (1434us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400941.573915:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 77 00010000:00010000:2.0:1786400941.574278:0:11770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006d0f1cfb/0x5ccaaf4f3cb1e6a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.574300:0:11770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d0f1cfb/0x5ccaaf4f3cb1e6a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.574341:0:11770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d0f1cfb/0x5ccaaf4f3cb1e6a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.574350:0:11770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d0f1cfb/0x5ccaaf4f3cb1e6a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.574358:0:11770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d0f1cfb/0x5ccaaf4f3cb1e6a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.574366:0:11770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1bb200 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:2.0:1786400941.574370:0:11770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d0f1cfb/0x5ccaaf4f3cb1e6a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.574379:0:11770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d0f1cfb/0x5ccaaf4f3cb1e6a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.574391:0:11770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d0f1cfb/0x5ccaaf4f3cb1e6a0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.574398:0:11770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d0f1cfb/0x5ccaaf4f3cb1e6a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400941.574482:0:11770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4908a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:096c63d9-38b8-441b-8c71-343db25fe88a+9:2362:x1873176850160000:12345-192.168.204.8@tcp:1:lfs.0 Request processed in 14937us (15346us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400941.574491:0:11770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 62 00000100:00100000:3.0:1786400941.579883:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400941.580662:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850160512 00000100:00100000:1.0:1786400941.580676:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850160512 00000100:00100000:1.0:1786400941.580865:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 56 00000100:00100000:1.0:1786400941.580876:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6d7e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+43:11573:x1873176850160512:12345-192.168.204.8@tcp:35:lfs.0 00000004:00010000:1.0:1786400941.580947:0:5791:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e692 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be59 expref: 43 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786400941.581420:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1786400941.581469:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1786400941.582871:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1786400941.582944:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e6a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.583034:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e64c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be36 expref: 47 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.583044:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e6a7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.583221:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e64c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be36 expref: 47 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.583237:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e64c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be36 expref: 47 pid: 5790 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400941.583267:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd599180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5791:1873176872165888:192.168.204.8@tcp:104: 00000100:00100000:1.0:1786400941.583481:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc924f240 going to sleep for 11 seconds 00000100:00100000:0.0:1786400941.590471:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400941.591115:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850160640 00000100:00100000:3.0:1786400941.591127:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850160640 00010000:00010000:3.0:1786400941.591172:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e64c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be36 expref: 48 pid: 5790 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400941.591219:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 78 00000100:00100000:3.0:1786400941.591229:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4909f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096c63d9-38b8-441b-8c71-343db25fe88a+48:2365:x1873176850160640:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786400941.591244:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400941.591264:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e64c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be36 expref: 48 pid: 5790 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.591278:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e64c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be36 expref: 48 pid: 5790 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.591299:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d6fe06cbf00) 00010000:00010000:3.0:1786400941.591304:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e6a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.591434:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e6a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.591444:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e6a7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.591466:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400941.591536:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4909f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096c63d9-38b8-441b-8c71-343db25fe88a+48:2365:x1873176850160640:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 308us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400941.591544:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 78 00010000:00010000:1.0:1786400941.592707:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e64c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be36 expref: 47 pid: 5790 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400941.592730:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd599180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5791:1873176872165888:192.168.204.8@tcp:104: 00010000:00010000:1.0:1786400941.592755:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e6a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.592765:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e6a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.592770:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e6a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786400941.592914:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1786400941.593162:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1786400941.593272:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd599180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5791:1873176872166016:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1786400941.593336:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400941.593374:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc924f180 going to sleep for 11 seconds 00000100:00100000:2.0:1786400941.595336:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872166016 00000100:00100000:2.0:1786400941.595350:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872166016 00000100:00100000:2.0:1786400941.595452:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1786400941.595462:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5791:x1873176872166016:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1786400941.595588:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5791:x1873176872166016:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 127us (2250us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400941.595596:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1786400941.595749:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd599180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5791:1873176872166016:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:0.0:1786400941.596173:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1786400941.597290:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1786400941.597385:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd599180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5791:1873176872166144:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1786400941.597452:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400941.597495:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc924f240 going to sleep for 11 seconds 00000100:00100000:2.0:1786400941.597935:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872166144 00000100:00100000:2.0:1786400941.597945:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872166144 00000100:00100000:2.0:1786400941.598075:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1786400941.598112:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5791:x1873176872166144:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1786400941.598349:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5791:x1873176872166144:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 264us (895us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1786400941.598358:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1786400941.598479:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd599180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5791:1873176872166144:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1786400941.598553:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1786400941.598703:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e6a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.598716:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e6a7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.598724:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e6a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.598730:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138f800 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400941.598735:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e6a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.598743:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e6a7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.598760:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d6fe06cbf00) 00010000:00010000:1.0:1786400941.598763:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1786400941.598768:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e6a7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400941.598774:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e6a7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1786400941.598967:0:5791:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1786400941.599115:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1786400941.599127:0:5791:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 394000040471ns, next at 395000037929ns, rc = 0 00000001:00080000:1.0:1786400941.599134:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1786400941.599170:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d6fe06cbf00) 00010000:00010000:1.0:1786400941.599174:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1786400941.599188:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e692 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be59 expref: 51 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400941.599284:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6d7e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+50:11573:x1873176850160512:12345-192.168.204.8@tcp:35:lfs.0 Request processed in 18410us (19410us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1786400941.599292:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 56 00000020:00080000:1.0:1786400941.599297:0:5791:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1786400941.604036:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400941.604158:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850160768 00000100:00100000:1.0:1786400941.604169:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850160768 00000100:00100000:0.0:1786400941.604408:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 203 00000100:00100000:0.0:1786400941.604420:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+50:11573:x1873176850160768:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:0.0:1786400941.604448:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400941.604473:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1e6ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6be60 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400941.604542:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1e6ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be60 expref: 51 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400941.604558:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1e6ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be60 expref: 51 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400941.604579:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:0.0:1786400941.604582:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786400941.604586:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5aba00, rc 0) 00000100:00100000:0.0:1786400941.604711:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+51:11573:x1873176850160768:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 293us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400941.604719:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 203 00000100:00100000:0.0:1786400941.608949:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400941.609051:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850161024 00000100:00100000:3.0:1786400941.609062:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850161024 00000100:00100000:3.0:1786400941.609921:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 57 00000100:00100000:3.0:1786400941.609936:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+51:11573:x1873176850161024:12345-192.168.204.8@tcp:35:lfs.0 00000100:00100000:3.0:1786400941.610229:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+52:11573:x1873176850161024:12345-192.168.204.8@tcp:35:lfs.0 Request processed in 297us (1289us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1786400941.610237:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 57 00000100:00100000:2.0:1786400941.826382:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400941.826421:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850161152 00000100:00100000:2.0:1786400941.826431:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850161152 00000100:00100000:2.0:1786400941.826483:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 204 00000100:00100000:2.0:1786400941.826493:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+52:11583:x1873176850161152:12345-192.168.204.8@tcp:34:lfs.0 00010000:00010000:2.0:1786400941.826574:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e6b5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.826604:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e6b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.826617:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e6b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.826635:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e6bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.826643:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e6bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.826649:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e6bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.826746:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba200/0x5ccaaf4f3cb1e6c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.826755:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba200/0x5ccaaf4f3cb1e6c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.826762:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba200/0x5ccaaf4f3cb1e6c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786400941.826803:0:6615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba200/0x5ccaaf4f3cb1e6c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.826816:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e6b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.826823:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e6b5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.826841:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e6b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.826846:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1ba800 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400941.826850:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e6b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.826858:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e6b5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.826920:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d6fc5599e00) 00010000:00010000:2.0:1786400941.826925:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400941.826930:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e6b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.826936:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e6b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.826949:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e6bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.826954:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e6bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.826960:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e6bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.826965:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1bbc00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400941.826968:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e6bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.826985:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e6bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.826993:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d6fd022eb00) 00010000:00010000:2.0:1786400941.826995:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400941.826998:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e6bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.827003:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e6bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.827018:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba200/0x5ccaaf4f3cb1e6c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.827024:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba200/0x5ccaaf4f3cb1e6c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.827030:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba200/0x5ccaaf4f3cb1e6c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.827035:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1ba200 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400941.827037:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba200/0x5ccaaf4f3cb1e6c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.827042:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba200/0x5ccaaf4f3cb1e6c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.827049:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:2.0:1786400941.827051:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400941.827053:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba200/0x5ccaaf4f3cb1e6c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400941.827107:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba200/0x5ccaaf4f3cb1e6c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400941.827194:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+52:11583:x1873176850161152:12345-192.168.204.8@tcp:34:lfs.0 Request processed in 701us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400941.827203:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 204 00000001:00080000:0.0:1786400941.859528:0:6619:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:0.0:1786400941.859570:0:6619:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:0.0:1786400941.859580:0:6619:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:0.0:1786400941.920300:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400941.920485:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850161408 00000100:00100000:3.0:1786400941.920906:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850161408 00000100:00100000:3.0:1786400941.921024:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 205 00000100:00100000:3.0:1786400941.921034:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+52:11586:x1873176850161408:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:3.0:1786400941.921056:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400941.921126:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091c00/0x5ccaaf4f3cb1e6ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6be67 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.922646:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e6d1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.922668:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e6d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.922680:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e6d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.922696:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e6d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.922703:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e6d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.922709:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e6d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.922845:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090400/0x5ccaaf4f3cb1e6df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.922853:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090400/0x5ccaaf4f3cb1e6df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.922860:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090400/0x5ccaaf4f3cb1e6df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400941.922887:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1786400941.922993:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e6d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.923001:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e6d1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.923008:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e6d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.923014:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca090e00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786400941.923018:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e6d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.923026:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e6d1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.923037:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d6fc5599e00) 00010000:00010000:3.0:1786400941.923040:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400941.923044:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e6d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.923050:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e6d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.923079:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e6d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.923134:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e6d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.923151:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e6d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.923155:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca091800 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786400941.923158:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e6d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.923164:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e6d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.923172:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d6fc5599100) 00010000:00010000:3.0:1786400941.923175:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400941.923177:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e6d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.923182:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e6d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.923227:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091c00/0x5ccaaf4f3cb1e6ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be67 expref: 55 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.923240:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090400/0x5ccaaf4f3cb1e6df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be67 expref: 54 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400941.923248:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:3.0:1786400941.923250:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786400941.923253:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca090400, rc 0) 00000100:00100000:3.0:1786400941.923330:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+54:11586:x1873176850161408:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 2296us (3039us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1786400941.923347:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 205 00000100:00100000:2.0:1786400941.931966:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400941.933236:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850161536 00000100:00100000:0.0:1786400941.933249:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850161536 00000100:00100000:0.0:1786400941.933937:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 206 00000100:00100000:0.0:1786400941.933951:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+54:11586:x1873176850161536:12345-192.168.204.8@tcp:54:lfs.0 00010000:00010000:0.0:1786400941.934021:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e6ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400941.934039:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e6ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400941.934051:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e6ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400941.934122:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e6ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400941.934130:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e6ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400941.934137:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e6ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400941.934142:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aaa00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400941.934146:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e6ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400941.934154:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e6ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400941.934196:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:0.0:1786400941.934199:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786400941.934206:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e6ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400941.934212:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e6ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400941.934301:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+54:11586:x1873176850161536:12345-192.168.204.8@tcp:54:lfs.0 Request processed in 354us (2342us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400941.934309:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 206 00000100:00100000:2.0:1786400941.942211:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400941.943148:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850161792 00000100:00100000:1.0:1786400941.943170:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850161792 00000100:00100000:1.0:1786400941.943235:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 58 00000100:00100000:1.0:1786400941.943246:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+54:11586:x1873176850161792:12345-192.168.204.8@tcp:35:lfs.0 00000100:00100000:1.0:1786400941.943513:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+55:11586:x1873176850161792:12345-192.168.204.8@tcp:35:lfs.0 Request processed in 269us (1313us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1786400941.943522:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 58 00010000:00010000:3.0:1786400941.998439:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400942.070857:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400942.070999:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850162048 00000100:00100000:0.0:1786400942.071011:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850162048 00000100:00100000:0.0:1786400942.071227:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 207 00000100:00100000:0.0:1786400942.071238:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+55:11596:x1873176850162048:12345-192.168.204.8@tcp:101:bash.0 00010000:00010000:0.0:1786400942.071265:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400942.071268:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1786400942.071298:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e66f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be4b expref: 55 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.071318:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d6fc5599e00) 00010000:00010000:0.0:1786400942.071322:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1786400942.071335:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e6f4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6be6e expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.071439:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e6fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.071469:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e6fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.071479:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e6fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400942.071490:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1786400942.071616:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e6f4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be6e expref: 57 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.071631:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e6fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be6e expref: 56 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.071638:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:0.0:1786400942.071641:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786400942.071644:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5aa600, rc 0) 00000100:00100000:0.0:1786400942.071706:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+56:11596:x1873176850162048:12345-192.168.204.8@tcp:101:bash.0 Request processed in 470us (860us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1786400942.071713:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 207 00000100:00080000:2.0:1786400942.072114:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400942.077170:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400942.077507:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850162304 00000100:00100000:2.0:1786400942.077527:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850162304 00000100:00100000:2.0:1786400942.077995:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 208 00000100:00100000:2.0:1786400942.078007:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+56:11596:x1873176850162304:12345-192.168.204.8@tcp:36:bash.0 00010000:00010000:2.0:1786400942.078080:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1786400942.078297:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e6fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be6e expref: 56 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400942.078319:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090400/0x5ccaaf4f3cb1e6df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be67 expref: 55 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400942.078329:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:2.0:1786400942.078334:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786400942.078888:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e709 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400942.078905:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e709 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400942.078934:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e709 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786400942.079082:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1786400942.079174:0:5789:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f0da76b2 reply state 0000000006639710 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e709 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400942.079184:0:5789:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786400942.079341:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+57:11596:x1873176850162304:12345-192.168.204.8@tcp:36:bash.0 Request processed in 1334us (2181us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1786400942.079350:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 208 00000020:00080000:2.0:1786400942.079356:0:5789:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1786400942.083017:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e709 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400942.083037:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e709 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400942.083044:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e709 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400942.083049:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1bbc00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400942.083065:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e709 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400942.083073:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e709 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400942.083112:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:2.0:1786400942.083115:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400942.083134:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e709 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400942.083140:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e709 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400942.083911:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400942.084620:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850162432 00000100:00100000:3.0:1786400942.084632:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850162432 00000100:00100000:3.0:1786400942.085022:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 209 00000100:00100000:3.0:1786400942.085034:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+56:11596:x1873176850162432:12345-192.168.204.8@tcp:101:bash.0 00010000:00010000:3.0:1786400942.085070:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400942.085118:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e710 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6be75 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400942.085205:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091c00/0x5ccaaf4f3cb1e717 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400942.085218:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091c00/0x5ccaaf4f3cb1e717 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400942.085230:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091c00/0x5ccaaf4f3cb1e717 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786400942.085259:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1786400942.085264:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786400942.085285:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091c00/0x5ccaaf4f3cb1e717 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400942.085315:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e710 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be75 expref: 58 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400942.085333:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091c00/0x5ccaaf4f3cb1e717 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be75 expref: 57 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400942.085357:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:3.0:1786400942.085360:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786400942.085364:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca091c00, rc 0) 00000100:00100000:3.0:1786400942.085433:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+57:11596:x1873176850162432:12345-192.168.204.8@tcp:101:bash.0 Request processed in 400us (1526us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400942.085439:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 209 00000100:00100000:1.0:1786400942.091940:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400942.092069:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850162688 00000100:00100000:0.0:1786400942.092080:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850162688 00000100:00100000:0.0:1786400942.092166:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 59 00000100:00100000:0.0:1786400942.092175:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd59aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+57:11596:x1873176850162688:12345-192.168.204.8@tcp:35:bash.0 00000100:00100000:0.0:1786400942.092427:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd59aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+58:11596:x1873176850162688:12345-192.168.204.8@tcp:35:bash.0 Request processed in 251us (498us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1786400942.092456:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 59 00000100:00100000:2.0:1786400942.168470:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400942.168684:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850162816 00000100:00100000:0.0:1786400942.168695:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850162816 00000100:00100000:0.0:1786400942.168803:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 210 00000100:00100000:0.0:1786400942.168814:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+58:11602:x1873176850162816:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:0.0:1786400942.168840:0:6615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400942.168863:0:6615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e71e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6be7c expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.168931:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e725 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.168957:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e725 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.168969:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e725 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400942.169033:0:6615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1786400942.169037:0:6615:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1786400942.169071:0:6615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e725 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.169136:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e71e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be7c expref: 60 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.169156:0:6615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e725 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be7c expref: 59 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.169183:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d6fc5599e00) 00010000:00010000:0.0:1786400942.169186:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786400942.169190:0:6615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5ab800, rc 0) 00000100:00100000:0.0:1786400942.169247:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+59:11602:x1873176850162816:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 435us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400942.169254:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 210 00000100:00100000:3.0:1786400942.175385:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400942.175713:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850162944 00000100:00100000:0.0:1786400942.175725:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850162944 00000100:00100000:0.0:1786400942.175930:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 211 00000100:00100000:0.0:1786400942.175942:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4984e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+59:11602:x1873176850162944:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:0.0:1786400942.176036:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400942.176073:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e72c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6be83 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.176160:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e733 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.176176:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e733 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.176187:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e733 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.176202:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e73a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.176209:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e73a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.176233:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e73a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.176337:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e741 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.176347:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e741 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.176354:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e741 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400942.176395:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1786400942.176400:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786400942.176422:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e741 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.176435:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e741 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.176443:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e733 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.176450:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e733 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.176456:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e733 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.176462:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5ab200 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400942.176466:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e733 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.176481:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e733 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.176496:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d6fc5599e00) 00010000:00010000:0.0:1786400942.176499:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400942.176505:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e733 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.176600:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e733 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.176616:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e73a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.176623:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e73a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.176629:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e73a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.176634:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5ab600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400942.176637:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e73a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.176643:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e73a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.176651:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d6fc90cd600) 00010000:00010000:0.0:1786400942.176654:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786400942.176656:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e73a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.176674:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e73a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.176711:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e72c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be83 expref: 61 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.176725:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e741 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be83 expref: 60 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.176732:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:0.0:1786400942.176735:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786400942.176737:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5aa400, rc 0) 00000100:00100000:0.0:1786400942.176814:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4984e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+60:11602:x1873176850162944:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 875us (1441us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400942.176823:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 211 00000100:00100000:1.0:1786400942.187354:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400942.188127:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850163200 00000100:00100000:0.0:1786400942.188141:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850163200 00000100:00100000:0.0:1786400942.188204:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 212 00000100:00100000:0.0:1786400942.188214:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+60:11602:x1873176850163200:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:0.0:1786400942.188238:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400942.188261:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e748 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6be8a expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.188369:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1e74f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.188385:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091c00/0x5ccaaf4f3cb1e717 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be75 expref: 61 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.188409:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e741 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be83 expref: 61 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.188417:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1e74f lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.188456:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e741 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be83 expref: 61 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.188470:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e741 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be83 expref: 61 pid: 5788 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400942.188484:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc9269c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5789:1873176872166272:192.168.204.8@tcp:104: 00010000:00010000:0.0:1786400942.188621:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091c00/0x5ccaaf4f3cb1e717 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be75 expref: 61 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.188631:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091c00/0x5ccaaf4f3cb1e717 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be75 expref: 61 pid: 5790 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400942.188640:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc926b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5789:1873176872166400:192.168.204.8@tcp:104: 00000100:00100000:0.0:1786400942.188665:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fee1f3900 going to sleep for 11 seconds 00000100:00100000:3.0:1786400942.189965:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400942.190420:0:8369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850163328 00000100:00100000:1.0:1786400942.190430:0:8369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850163328 00010000:00010000:1.0:1786400942.190470:0:8369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e741 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be83 expref: 62 pid: 5788 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400942.190499:0:8369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 79 00000100:00100000:1.0:1786400942.191083:0:8369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4986680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+62:2363:x1873176850163328:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400942.191127:0:8369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400942.191137:0:8369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e741 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be83 expref: 62 pid: 5788 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400942.191168:0:8369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e741 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be83 expref: 62 pid: 5788 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400942.191193:0:8369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:1.0:1786400942.191198:0:8369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1e74f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400942.191206:0:8369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1e74f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400942.191212:0:8369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400942.191270:0:8369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4986680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+62:2363:x1873176850163328:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 763us (1311us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400942.191279:0:8369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 79 00010000:00010000:0.0:1786400942.194044:0:5789:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.8@tcp) returned -22 from blocking AST (req@00000000ac7ec611 x1873176872166272) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e741 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be83 expref: 61 pid: 5788 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.194079:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e741 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be83 expref: 61 pid: 5788 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400942.194135:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc9269c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5789:1873176872166272:192.168.204.8@tcp:104: 00000100:00100000:0.0:1786400942.194150:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc926b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5789:1873176872166400:192.168.204.8@tcp:104: 00010000:00010000:0.0:1786400942.194177:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:0.0:1786400942.194182:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1e74f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.194191:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1e74f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.194200:0:5789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1e74f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400942.196902:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400942.197941:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850163456 00000100:00100000:2.0:1786400942.198022:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850163456 00010000:00010000:2.0:1786400942.198125:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091c00/0x5ccaaf4f3cb1e717 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be75 expref: 61 pid: 5790 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400942.198163:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 80 00000100:00100000:2.0:1786400942.198173:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4984000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096c63d9-38b8-441b-8c71-343db25fe88a+61:2364:x1873176850163456:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786400942.198189:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400942.198196:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091c00/0x5ccaaf4f3cb1e717 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be75 expref: 61 pid: 5790 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400942.198210:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091c00/0x5ccaaf4f3cb1e717 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be75 expref: 61 pid: 5790 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400942.198232:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091c00/0x5ccaaf4f3cb1e717 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be75 expref: 61 pid: 5790 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400942.198248:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:2.0:1786400942.198254:0:5774:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1e74f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400942.198264:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1e74f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400942.198286:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1e74f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400942.198317:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400942.198381:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4984000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096c63d9-38b8-441b-8c71-343db25fe88a+60:2364:x1873176850163456:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 209us (1488us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400942.198389:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 80 00010000:00010000:0.0:1786400942.198827:0:5789:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1e74f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.198836:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1e74f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400942.198858:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1786400942.199321:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1e748 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be8a expref: 61 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.199341:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1e74f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be8a expref: 60 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400942.199349:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:0.0:1786400942.199352:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1786400942.199364:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5aac00, rc 0) 00000100:00100000:0.0:1786400942.199404:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+60:11602:x1873176850163200:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 11192us (12063us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1786400942.199413:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 212 00000100:00100000:3.0:1786400942.208310:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400942.210467:0:8369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850163712 00000100:00100000:1.0:1786400942.210482:0:8369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850163712 00000100:00100000:1.0:1786400942.210556:0:8369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 16 00000100:00100000:1.0:1786400942.210567:0:8369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4589050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+60:11602:x1873176850163712:12345-192.168.204.8@tcp:103:lfs.0 00010000:00010000:1.0:1786400942.210583:0:8369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400942.210609:0:8369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1e6ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be60 expref: 60 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400942.210632:0:8369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:1.0:1786400942.210638:0:8369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400942.210710:0:8369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4589050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+59:11602:x1873176850163712:12345-192.168.204.8@tcp:103:lfs.0 Request processed in 144us (2408us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400942.210735:0:8369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 16 00000100:00100000:2.0:1786400942.222247:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400942.222368:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850163840 00000100:00100000:3.0:1786400942.222382:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850163840 00000100:00100000:3.0:1786400942.222454:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 213 00000100:00100000:3.0:1786400942.222465:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+59:11602:x1873176850163840:12345-192.168.204.8@tcp:58:lfs.0 00010000:00010000:3.0:1786400942.222861:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e75d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400942.222879:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e75d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400942.222891:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e75d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786400942.224224:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1786400942.225062:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+59:11602:x1873176850163840:12345-192.168.204.8@tcp:58:lfs.0 Request processed in 2582us (2809us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400942.225074:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 213 00000100:00100000:0.0:1786400942.227999:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400942.228473:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850163968 00000100:00100000:1.0:1786400942.228483:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850163968 00000100:00100000:1.0:1786400942.228588:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 214 00000100:00100000:1.0:1786400942.228598:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc926b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+59:11602:x1873176850163968:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:1.0:1786400942.228631:0:6615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786400942.228651:0:6615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e764 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6be91 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400942.228708:0:6615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e75d lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400942.228719:0:6615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e764 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be91 expref: 60 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400942.228738:0:6615:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e75d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400942.228753:0:6615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e764 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be91 expref: 60 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400942.229394:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:1.0:1786400942.229397:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786400942.229407:0:6615:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e764 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be91 expref: 60 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400942.229417:0:6615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138f400, rc 0) 00000100:00100000:1.0:1786400942.229486:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc926b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+60:11602:x1873176850163968:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 889us (1497us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400942.229509:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 214 00010000:00010000:3.0:1786400943.022534:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786400943.214487:0:11546:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786400943.214498:0:11546:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786400943.214539:0:11546:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1786400943.214546:0:11546:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786400943.214677:0:11546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc9269c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11546:1873176872166528:192.168.204.8@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1786400943.214798:0:11546:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fee1f3540 going to sleep for 11 seconds 00000100:00100000:2.0:1786400943.222464:0:11546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc9269c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11546:1873176872166528:192.168.204.8@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1786400943.224692:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400943.225310:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850164096 00000100:00100000:0.0:1786400943.225321:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850164096 00000100:00100000:0.0:1786400943.225424:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 215 00000100:00100000:0.0:1786400943.225435:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+60:11603:x1873176850164096:12345-192.168.204.8@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1786400943.225468:0:5788:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1786400943.225582:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+60:11603:x1873176850164096:12345-192.168.204.8@tcp:53:lhsmtool_posix.0 Request processed in 148us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400943.225590:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 215 00000100:00100000:0.0:1786400943.233719:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400943.233809:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850164224 00000100:00100000:2.0:1786400943.233818:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850164224 00000100:00100000:2.0:1786400943.233891:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 216 00000100:00100000:2.0:1786400943.233901:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9269880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+60:11603:x1873176850164224:12345-192.168.204.8@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1786400943.233992:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb800/0x5ccaaf4f3cb1e76b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.234009:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb800/0x5ccaaf4f3cb1e76b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.234021:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb800/0x5ccaaf4f3cb1e76b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.234122:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bac00/0x5ccaaf4f3cb1e772 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.234145:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bac00/0x5ccaaf4f3cb1e772 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.234153:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bac00/0x5ccaaf4f3cb1e772 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.234181:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb600/0x5ccaaf4f3cb1e779 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.234189:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb600/0x5ccaaf4f3cb1e779 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.234196:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb600/0x5ccaaf4f3cb1e779 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400943.234234:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1786400943.234237:0:5789:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786400943.234247:0:5789:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb600/0x5ccaaf4f3cb1e779 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.234257:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb800/0x5ccaaf4f3cb1e76b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.234264:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb800/0x5ccaaf4f3cb1e76b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.234270:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb800/0x5ccaaf4f3cb1e76b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.234276:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1bb800 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400943.234279:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb800/0x5ccaaf4f3cb1e76b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.234294:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb800/0x5ccaaf4f3cb1e76b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.234306:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d6fc5599600) 00010000:00010000:2.0:1786400943.234310:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400943.234314:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb800/0x5ccaaf4f3cb1e76b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.234320:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb800/0x5ccaaf4f3cb1e76b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.234333:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bac00/0x5ccaaf4f3cb1e772 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.234339:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bac00/0x5ccaaf4f3cb1e772 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.234345:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bac00/0x5ccaaf4f3cb1e772 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.234351:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1bac00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400943.234353:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bac00/0x5ccaaf4f3cb1e772 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.234359:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bac00/0x5ccaaf4f3cb1e772 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.234366:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9d6fd022ed00) 00010000:00010000:2.0:1786400943.234369:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400943.234371:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bac00/0x5ccaaf4f3cb1e772 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.234386:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bac00/0x5ccaaf4f3cb1e772 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.234402:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb600/0x5ccaaf4f3cb1e779 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.234408:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb600/0x5ccaaf4f3cb1e779 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.234414:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb600/0x5ccaaf4f3cb1e779 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.234418:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1bb600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400943.234422:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb600/0x5ccaaf4f3cb1e779 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.234427:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb600/0x5ccaaf4f3cb1e779 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.234436:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:2.0:1786400943.234438:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400943.234441:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb600/0x5ccaaf4f3cb1e779 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.234447:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb600/0x5ccaaf4f3cb1e779 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400943.234534:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9269880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+60:11603:x1873176850164224:12345-192.168.204.8@tcp:34:lhsmtool_posix.0 Request processed in 633us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400943.234543:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 216 00000100:00100000:1.0:1786400943.237845:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400943.237963:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850164480 00000100:00100000:2.0:1786400943.238079:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850164480 00000100:00100000:2.0:1786400943.238166:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 217 00000100:00100000:2.0:1786400943.238176:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd59bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+60:11603:x1873176850164480:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786400943.238196:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400943.238216:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bae00/0x5ccaaf4f3cb1e780 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6be98 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.238521:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb400/0x5ccaaf4f3cb1e787 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.238538:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb400/0x5ccaaf4f3cb1e787 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.238548:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb400/0x5ccaaf4f3cb1e787 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400943.238559:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1786400943.238655:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb400/0x5ccaaf4f3cb1e787 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.238663:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb400/0x5ccaaf4f3cb1e787 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.238669:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb400/0x5ccaaf4f3cb1e787 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.238674:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1bb400 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400943.238678:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb400/0x5ccaaf4f3cb1e787 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.238686:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb400/0x5ccaaf4f3cb1e787 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.238709:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:2.0:1786400943.238712:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1786400943.238717:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb400/0x5ccaaf4f3cb1e787 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.238724:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb400/0x5ccaaf4f3cb1e787 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.238772:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bae00/0x5ccaaf4f3cb1e780 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be98 expref: 62 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.238782:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d6fc5599600) 00010000:00010000:2.0:1786400943.238784:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1786400943.238788:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bae00/0x5ccaaf4f3cb1e780 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be98 expref: 62 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.238797:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fee1bae00, rc 0) 00000100:00100000:2.0:1786400943.238868:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd59bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+61:11603:x1873176850164480:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 693us (1033us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1786400943.238876:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 217 00000100:00100000:0.0:1786400943.245444:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400943.245773:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850164608 00000100:00100000:2.0:1786400943.245785:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850164608 00000100:00100000:2.0:1786400943.246067:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 218 00000100:00100000:2.0:1786400943.246079:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc926aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+61:11603:x1873176850164608:12345-192.168.204.8@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1786400943.246156:0:5789:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1786400943.246381:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc926aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+61:11603:x1873176850164608:12345-192.168.204.8@tcp:53:lhsmtool_posix.0 Request processed in 303us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400943.246404:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 218 00000100:00100000:3.0:1786400943.256205:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400943.257058:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850164864 00000100:00100000:2.0:1786400943.257069:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850164864 00000100:00100000:2.0:1786400943.257162:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 219 00000100:00100000:2.0:1786400943.257173:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+61:11603:x1873176850164864:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786400943.257194:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400943.257196:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1786400943.257224:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e725 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be7c expref: 61 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.257244:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d6fc5599e00) 00010000:00010000:2.0:1786400943.257261:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786400943.257276:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bae00/0x5ccaaf4f3cb1e795 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6be9f expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1786400943.257684:0:5790:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1786400943.257887:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb400/0x5ccaaf4f3cb1e79c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.257900:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb400/0x5ccaaf4f3cb1e79c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.257911:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb400/0x5ccaaf4f3cb1e79c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.257964:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bae00/0x5ccaaf4f3cb1e795 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be9f expref: 63 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.258001:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb400/0x5ccaaf4f3cb1e79c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be9f expref: 62 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.258009:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d6fd022ed00) 00010000:00010000:2.0:1786400943.258012:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786400943.258015:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fee1bb400, rc 0) 00000100:00100000:2.0:1786400943.259476:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+62:11603:x1873176850164864:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 2294us (3272us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1786400943.259489:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 219 00000100:00100000:3.0:1786400943.264758:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400943.268141:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850165120 00000100:00100000:1.0:1786400943.268158:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850165120 00000100:00100000:1.0:1786400943.268232:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 220 00000100:00100000:1.0:1786400943.268625:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+62:11603:x1873176850165120:12345-192.168.204.8@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1786400943.268691:0:6615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400943.268721:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb400/0x5ccaaf4f3cb1e79c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be9f expref: 62 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.268741:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d6fd022ed00) 00010000:00010000:1.0:1786400943.268755:0:6615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786400943.268779:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e7aa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.268792:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e7aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.268801:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e7aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.268868:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e7b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x8c99c369 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.268875:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e7b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8c99c369 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.268882:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e7b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8c99c369 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.270178:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e7aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.270193:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e7aa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.270201:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e7aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.270207:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138f200 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400943.270212:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e7aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.270220:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e7aa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.270233:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d6fc5599e00) 00010000:00010000:1.0:1786400943.270236:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400943.270240:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e7aa lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.270329:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e7aa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.270345:0:6615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e7b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8c99c369 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.270352:0:6615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e7b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8c99c369 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.270357:0:6615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e7b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8c99c369 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.270377:0:6615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138fa00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400943.270380:0:6615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e7b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8c99c369 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.270387:0:6615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e7b1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8c99c369 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.270395:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x8c99c369 (ffff9d6fe06cbf00) 00010000:00010000:1.0:1786400943.270398:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400943.270401:0:6615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e7b1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x8c99c369 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.270407:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e7b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x8c99c369 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400943.270889:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4987b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+61:11603:x1873176850165120:12345-192.168.204.8@tcp:36:lhsmtool_posix.0 Request processed in 2642us (6141us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786400943.270899:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 220 00000100:00100000:1.0:1786400943.279372:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400943.279495:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850165248 00000100:00100000:0.0:1786400943.279505:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850165248 00000100:00100000:0.0:1786400943.279568:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 221 00000100:00100000:0.0:1786400943.279578:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+61:11603:x1873176850165248:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786400943.279599:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400943.279624:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e7b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bea6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.279677:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e7bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.279691:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e7bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.279702:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e7bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.279813:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1e7b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bea6 expref: 63 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.279833:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e7bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bea6 expref: 62 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.279842:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d6fc90cd600) 00010000:00010000:0.0:1786400943.279845:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1786400943.279848:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5ab600, rc 0) 00000100:00100000:0.0:1786400943.279911:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+62:11603:x1873176850165248:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 334us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400943.279918:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 221 00000100:00100000:3.0:1786400943.288165:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400943.288814:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850165504 00000100:00100000:2.0:1786400943.288825:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850165504 00000100:00100000:2.0:1786400943.288949:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 222 00000100:00100000:2.0:1786400943.288959:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+62:11603:x1873176850165504:12345-192.168.204.8@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786400943.289064:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bae00/0x5ccaaf4f3cb1e7c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.289083:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bae00/0x5ccaaf4f3cb1e7c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.289119:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bae00/0x5ccaaf4f3cb1e7c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786400943.290203:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:2.0:1786400943.290216:0:5789:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 395691129179ns, next at 396691126819ns, rc = 0 00000004:00010000:2.0:1786400943.290558:0:5789:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004d82eec3 reply state 0000000053a750b1 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bae00/0x5ccaaf4f3cb1e7c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400943.290588:0:5789:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786400943.290701:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+64:11603:x1873176850165504:12345-192.168.204.8@tcp:36:lhsmtool_posix.0 Request processed in 1740us (2542us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1786400943.290708:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 222 00010000:00010000:1.0:1786400943.296626:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bae00/0x5ccaaf4f3cb1e7c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.296645:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bae00/0x5ccaaf4f3cb1e7c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.296657:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bae00/0x5ccaaf4f3cb1e7c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.296663:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1bae00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400943.296668:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bae00/0x5ccaaf4f3cb1e7c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.296693:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bae00/0x5ccaaf4f3cb1e7c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.296710:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d6fc90cd600) 00010000:00010000:1.0:1786400943.296714:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786400943.296718:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bae00/0x5ccaaf4f3cb1e7c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.296724:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bae00/0x5ccaaf4f3cb1e7c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400943.298547:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400943.298664:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850165632 00000100:00100000:0.0:1786400943.298674:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850165632 00000100:00100000:0.0:1786400943.299434:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 223 00000100:00100000:0.0:1786400943.299450:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+63:11603:x1873176850165632:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786400943.299476:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400943.299497:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e7cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bead expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.299578:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e7cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bead expref: 64 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.299594:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e7cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bead expref: 64 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.299616:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d6fc90cd600) 00010000:00010000:0.0:1786400943.299619:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786400943.299623:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5ab200, rc 0) 00000100:00100000:0.0:1786400943.299693:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+64:11603:x1873176850165632:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 247us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400943.299701:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 223 00000100:00100000:3.0:1786400943.303567:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400943.303901:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850165760 00000100:00100000:0.0:1786400943.303911:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850165760 00000100:00100000:0.0:1786400943.304165:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 63 00000100:00100000:0.0:1786400943.304175:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+9:2365:x1873176850165760:12345-192.168.204.8@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1786400943.304587:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+10:2365:x1873176850165760:12345-192.168.204.8@tcp:2:lhsmtool_posix.0 Request processed in 411us (1028us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1786400943.304596:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 63 00000100:00080000:2.0:1786400943.305670:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786400943.308729:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400943.308994:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850166016 00000100:00100000:0.0:1786400943.309005:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850166016 00000100:00100000:0.0:1786400943.309078:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 60 00000100:00100000:0.0:1786400943.309166:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd59b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+64:11603:x1873176850166016:12345-192.168.204.8@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1786400943.309510:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd59b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+65:11603:x1873176850166016:12345-192.168.204.8@tcp:35:lhsmtool_posix.0 Request processed in 422us (790us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1786400943.309533:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 60 00000100:00100000:3.0:1786400943.311873:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400943.312419:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850166272 00000100:00100000:1.0:1786400943.312430:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850166272 00000100:00100000:1.0:1786400943.312624:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 224 00000100:00100000:1.0:1786400943.312635:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+65:11603:x1873176850166272:12345-192.168.204.8@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1786400943.312764:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+65:11603:x1873176850166272:12345-192.168.204.8@tcp:57:lhsmtool_posix.0 Request processed in 131us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400943.312772:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 224 00000100:00100000:3.0:1786400943.315855:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400943.316141:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850166400 00000100:00100000:2.0:1786400943.316151:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850166400 00000100:00100000:2.0:1786400943.316206:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 225 00000100:00100000:2.0:1786400943.316215:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee350a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+65:11603:x1873176850166400:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786400943.316239:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400943.316265:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb600/0x5ccaaf4f3cb1e7d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6beb4 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.316341:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bac00/0x5ccaaf4f3cb1e7db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.316356:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bac00/0x5ccaaf4f3cb1e7db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.316367:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bac00/0x5ccaaf4f3cb1e7db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400943.316408:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786400943.316427:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bac00/0x5ccaaf4f3cb1e7db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.316455:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb600/0x5ccaaf4f3cb1e7d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6beb4 expref: 67 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.316492:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bac00/0x5ccaaf4f3cb1e7db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6beb4 expref: 66 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.316501:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d6fc90cd600) 00010000:00010000:2.0:1786400943.316504:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1786400943.316508:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fee1bac00, rc 0) 00000100:00100000:2.0:1786400943.316828:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee350a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+66:11603:x1873176850166400:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 612us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400943.316836:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 225 00000100:00100000:0.0:1786400943.320455:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400943.320764:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850166528 00000100:00100000:3.0:1786400943.320774:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850166528 00000100:00100000:3.0:1786400943.320904:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 64 00000100:00100000:3.0:1786400943.320915:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9268a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+10:2365:x1873176850166528:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786400943.320946:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786400943.320970:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1e7e2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bebb expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786400943.320998:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a7a50ae, blocks: 0x1 00010000:00010000:3.0:1786400943.321020:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1786400943.321024:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400943.321047:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1e7e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bebb expref: 11 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400943.321066:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1e7e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bebb expref: 11 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400943.321079:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca090e00, rc 0) 00000100:00100000:3.0:1786400943.321192:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9268a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+11:2365:x1873176850166528:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 279us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400943.321200:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 64 00000100:00100000:3.0:1786400943.324489:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400943.324895:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850166784 00000100:00100000:2.0:1786400943.324907:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850166784 00000100:00100000:2.0:1786400943.325137:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 226 00000100:00100000:2.0:1786400943.325148:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee351500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+66:11603:x1873176850166784:12345-192.168.204.8@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1786400943.325261:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee351500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+66:11603:x1873176850166784:12345-192.168.204.8@tcp:57:lhsmtool_posix.0 Request processed in 115us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400943.325269:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 226 00000100:00100000:1.0:1786400943.328674:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400943.328802:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850166912 00000100:00100000:0.0:1786400943.328812:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850166912 00000100:00100000:0.0:1786400943.328909:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 65 00000100:00100000:0.0:1786400943.328920:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd59a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+11:11603:x1873176850166912:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786400943.328949:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400943.328968:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bd7a053/0x5ccaaf4f3cb1e7e9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bec2 expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.329006:0:6592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1e7e2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bebb expref: 12 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.329016:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786400943.329020:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786400943.329026:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bd7a053/0x5ccaaf4f3cb1e7e9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bec2 expref: 12 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.329078:0:6592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1e7e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bebb expref: 12 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.329143:0:6592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1e7e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bebb expref: 12 pid: 6590 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400943.329158:0:6592:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc9269c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6592:1873176872166656:192.168.204.8@tcp:104: 00000100:00100000:0.0:1786400943.329424:0:6592:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fee1f3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1786400943.333504:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400943.333643:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850167040 00000100:00100000:2.0:1786400943.333654:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850167040 00010000:00010000:2.0:1786400943.333719:0:5774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1e7e2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bebb expref: 13 pid: 6590 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400943.334042:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 81 00000100:00100000:2.0:1786400943.334055:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff69b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096c63d9-38b8-441b-8c71-343db25fe88a+13:2365:x1873176850167040:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786400943.334071:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400943.334137:0:5774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1e7e2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bebb expref: 13 pid: 6590 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.334151:0:5774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1e7e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bebb expref: 13 pid: 6590 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.334175:0:5774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400943.334180:0:5774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400943.334188:0:5774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005bd7a053/0x5ccaaf4f3cb1e7e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bec2 expref: 13 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.334198:0:5774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bd7a053/0x5ccaaf4f3cb1e7e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bec2 expref: 13 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.334233:0:5774:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005bd7a053/0x5ccaaf4f3cb1e7e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bec2 expref: 13 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400943.334246:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee1be680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5774:1873176872166784:192.168.204.8@tcp:105: 00000100:00100000:2.0:1786400943.334329:0:5774:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff6ec9a80 going to sleep for 11 seconds 00010000:00010000:3.0:1786400943.335577:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1e7e2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bebb expref: 13 pid: 6590 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400943.335615:0:6592:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc9269c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6592:1873176872166656:192.168.204.8@tcp:104: 00010000:00010000:3.0:1786400943.335643:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005bd7a053/0x5ccaaf4f3cb1e7e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bec2 expref: 12 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400943.335656:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5aa600, rc 0) 00000100:00100000:3.0:1786400943.335718:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd59a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+12:11603:x1873176850166912:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 6799us (7053us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400943.335726:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 65 00000100:00100000:2.0:1786400943.343974:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee1be680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5774:1873176872166784:192.168.204.8@tcp:105: 00010000:00010000:2.0:1786400943.344003:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400943.346378:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff69b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096c63d9-38b8-441b-8c71-343db25fe88a+11:2365:x1873176850167040:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 12313us (12869us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400943.346393:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 81 00000100:00100000:1.0:1786400943.354509:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400943.354617:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850167168 00000100:00100000:2.0:1786400943.354627:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850167168 00002000:00100000:2.0:1786400943.354692:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9d6fc97f6a00 x1873176850167168/t0(0) o4->096c63d9-38b8-441b-8c71-343db25fe88a@192.168.204.8@tcp:739/0 lens 504/0 e 0 to 0 dl 1786400954 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786400943.354702:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6fc97f6a00 with x1873176850167168 ext(0->12) 00002000:00010000:2.0:1786400943.354708:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d6fc97f6a00 00000100:00100000:2.0:1786400943.354744:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 7 00000100:00100000:2.0:1786400943.354753:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:096c63d9-38b8-441b-8c71-343db25fe88a+11:2362:x1873176850167168:12345-192.168.204.8@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1786400943.355260:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:096c63d9-38b8-441b-8c71-343db25fe88a+13:2362:x1873176850167168:12345-192.168.204.8@tcp:4:lhsmtool_posix.0 Request processed in 506us (762us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1786400943.355269:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 7 00002000:00100000:2.0:1786400943.355276:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9d6fc97f6a00 x1873176850167168/t4294967321(0) o4->096c63d9-38b8-441b-8c71-343db25fe88a@192.168.204.8@tcp:739/0 lens 504/448 e 0 to 0 dl 1786400954 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1786400943.355284:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6fc97f6a00 with x1873176850167168 ext(0->12) 00002000:00010000:2.0:1786400943.355288:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d6fc97f6a00 00000100:00100000:1.0:1786400943.360737:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400943.361000:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850167296 00000100:00100000:0.0:1786400943.361011:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850167296 00000100:00100000:0.0:1786400943.361524:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 227 00000100:00100000:0.0:1786400943.361536:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+66:11603:x1873176850167296:12345-192.168.204.8@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1786400943.417016:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+66:11603:x1873176850167296:12345-192.168.204.8@tcp:44:lhsmtool_posix.0 Request processed in 55471us (56277us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400943.417039:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 227 00000001:00080000:1.0:1786400943.417122:0:5810:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:1.0:1786400943.417148:0:5810:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d6fee1f3f00 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1786400943.417153:0:5810:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d6ec10e1200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d6ffa3aee40 00000020:00080000:1.0:1786400943.417156:0:5810:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d6ec10e1b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d6fc3402400 00000004:00080000:1.0:1786400943.417190:0:5810:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1786400943.417232:0:5810:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d6fc924f180 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1786400943.417235:0:5810:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d6fee186f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d6fc924fa80 00000020:00080000:1.0:1786400943.417238:0:5810:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d6fee186100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d6fc4ef7000 00000004:00080000:1.0:1786400943.417259:0:5810:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:1.0:1786400943.417293:0:5810:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000100:00100000:1.0:1786400943.417475:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdb87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872166912:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1786400943.417533:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400943.417607:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc34c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872167040:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786400943.417634:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400943.417666:0:11770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872166912 00000100:00100000:1.0:1786400943.417673:0:11770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872166912 00000100:00100000:1.0:1786400943.417721:0:11770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872167040 00000100:00100000:1.0:1786400943.417725:0:11770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872167040 00000100:00100000:1.0:1786400943.417745:0:11770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1786400943.417771:0:11770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc34c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1873176872166912:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1786400943.417796:0:11770:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:1.0:1786400943.417820:0:11770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c57ec4d/0x5ccaaf4f3cb1e7f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.417839:0:11770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b1a483a6/0x5ccaaf4f3cb1e5b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be21 expref: 12 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.417847:0:11770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1786400943.417851:0:11770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786400943.417855:0:11770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c57ec4d/0x5ccaaf4f3cb1e7f0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.417897:0:11770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b1a483a6/0x5ccaaf4f3cb1e5b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be21 expref: 12 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.417911:0:11770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b1a483a6/0x5ccaaf4f3cb1e5b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be21 expref: 12 pid: 6592 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400943.417922:0:11770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd001500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11770:1873176872167168:192.168.204.8@tcp:104: 00000100:00100000:1.0:1786400943.417964:0:11770:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc924fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1786400943.417981:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1786400943.417989:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd000000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3308:x1873176872167040:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1786400943.418167:0:6590:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1786400943.418172:0:6590:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1786400942 00002000:00010000:1.0:1786400943.418174:0:6590:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786400943.418176:0:6590:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1786400942 -> 1786400942 00002000:00010000:1.0:1786400943.418178:0:6590:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1786400943.418215:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd000000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3308:x1873176872167040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 226us (578us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1786400943.418221:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1786400943.418239:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1786400943.418279:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d6fc34c3b80/2, rc 0, transno 4294967322 00000100:00100000:1.0:1786400943.418285:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc34c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872167040:0@lo:2:osp-syn-1-0.0 00000020:00080000:2.0:1786400943.418630:0:5822:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1786400943.418807:0:5822:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1786400943.420537:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff69b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872167296:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1786400943.420612:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400943.422123:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872167296 00000100:00100000:3.0:1786400943.422136:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872167296 00000100:00100000:3.0:1786400943.422368:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1786400943.422379:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872167296:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1786400943.422408:0:6590:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:3.0:1786400943.422445:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a7a50ac, atime: 0x6a7a50ac, ctime: 0x6a7a50ac, blocks: 0xb 00010000:00010000:3.0:1786400943.422452:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b951b0ca/0x5ccaaf4f3cb1e7f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400943.422467:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1786400943.422472:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786400943.422478:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b951b0ca/0x5ccaaf4f3cb1e7f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400943.422492:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b951b0ca/0x5ccaaf4f3cb1e7f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400943.422522:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b951b0ca/0x5ccaaf4f3cb1e7f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400943.422529:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b951b0ca/0x5ccaaf4f3cb1e7f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400943.422557:0:6590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786400943.423195:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1873176872167296:12345-0@lo:6:osp-syn-0-0.0 Request processed in 816us (2580us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1786400943.423204:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1786400943.424935:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400943.424965:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:0.0:1786400943.425046:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786400943.425054:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b951b0ca/0x5ccaaf4f3cb1e7f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.425067:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca090200 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:0.0:1786400943.425073:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b951b0ca/0x5ccaaf4f3cb1e7f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.425083:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b951b0ca/0x5ccaaf4f3cb1e7f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.425140:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b951b0ca/0x5ccaaf4f3cb1e7f7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.425148:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b951b0ca/0x5ccaaf4f3cb1e7f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.425189:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400943.425192:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400943.425193:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400943.425293:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:3.0:1786400943.425300:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967309 00000004:00080000:3.0:1786400943.425320:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d6ffdb87800, transno 4294967307 00000004:00080000:3.0:1786400943.425338:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:3.0:1786400943.425354:0:3309:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9d6ff69b6d80 x1873176872167296/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1786400959 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1786400943.425365:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d6ff69b6d80/2, rc 0, transno 4294967310 00000100:00100000:3.0:1786400943.425371:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff69b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872167296:0@lo:6:osp-syn-0-0.0 00000100:00080000:1.0:1786400943.425915:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786400943.425936:0:8369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850167552 00000100:00100000:1.0:1786400943.425943:0:8369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850167552 00010000:00010000:1.0:1786400943.425975:0:8369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b1a483a6/0x5ccaaf4f3cb1e5b2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be21 expref: 13 pid: 6592 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400943.426016:0:8369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 82 00000100:00100000:1.0:1786400943.426027:0:8369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee350000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+13:2365:x1873176850167552:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400943.426051:0:8369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400943.426057:0:8369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b1a483a6/0x5ccaaf4f3cb1e5b2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be21 expref: 13 pid: 6592 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.426069:0:8369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b1a483a6/0x5ccaaf4f3cb1e5b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be21 expref: 13 pid: 6592 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400943.426148:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850167424 00000100:00100000:0.0:1786400943.426153:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850167424 00000100:00100000:0.0:1786400943.426180:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 69 00000100:00100000:0.0:1786400943.426186:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+14:2364:x1873176850167424:12345-192.168.204.8@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1786400943.426277:0:8369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786400943.426282:0:8369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786400943.426288:0:8369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000c57ec4d/0x5ccaaf4f3cb1e7f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.426300:0:8369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c57ec4d/0x5ccaaf4f3cb1e7f0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.426321:0:8369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400943.426417:0:8369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee350000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+14:2365:x1873176850167552:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 391us (1450us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400943.426425:0:8369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 82 00010000:00010000:2.0:1786400943.428163:0:11770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1a483a6/0x5ccaaf4f3cb1e5b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be21 expref: 13 pid: 6592 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400943.428185:0:11770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd001500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11770:1873176872167168:192.168.204.8@tcp:104: 00010000:00010000:2.0:1786400943.428208:0:11770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000c57ec4d/0x5ccaaf4f3cb1e7f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.429849:0:11770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000c57ec4d/0x5ccaaf4f3cb1e7f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.429888:0:11770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c57ec4d/0x5ccaaf4f3cb1e7f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.429900:0:11770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c57ec4d/0x5ccaaf4f3cb1e7f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.429909:0:11770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c57ec4d/0x5ccaaf4f3cb1e7f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.429931:0:11770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1786400943.430540:0:11770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc34c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3307:x1873176872166912:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12768us (13002us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1786400943.430550:0:11770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:3.0:1786400943.431435:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786400943.431447:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c57ec4d/0x5ccaaf4f3cb1e7f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400943.431459:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138f800 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:3.0:1786400943.431469:0:5776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c57ec4d/0x5ccaaf4f3cb1e7f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400943.431479:0:5776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c57ec4d/0x5ccaaf4f3cb1e7f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400943.431498:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c57ec4d/0x5ccaaf4f3cb1e7f0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400943.431505:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c57ec4d/0x5ccaaf4f3cb1e7f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400943.431677:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400943.431679:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400943.431681:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1786400943.434986:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d6ffdb87100/2, rc 0, transno 4294967323 00000100:00100000:1.0:1786400943.435001:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdb87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872166912:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1786400943.465290:0:7501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:3.0:1786400943.465422:0:7501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:3.0:1786400943.465431:0:7501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:0.0:1786400943.465882:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee350e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+7:2364:x1873176850167424:12345-192.168.204.8@tcp:16:lhsmtool_posix.0 Request processed in 39686us (40945us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400943.465895:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 69 00000100:00100000:3.0:1786400943.470621:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400943.470741:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850167808 00000100:00100000:1.0:1786400943.470750:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850167808 00000100:00100000:1.0:1786400943.470868:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 228 00000100:00100000:1.0:1786400943.470878:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee353800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+20:11603:x1873176850167808:12345-192.168.204.8@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1786400943.470945:0:6615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400943.470973:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bac00/0x5ccaaf4f3cb1e7db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6beb4 expref: 20 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.470993:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d6fc90cd600) 00010000:00010000:1.0:1786400943.470999:0:6615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786400943.471041:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e7fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.471054:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e7fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.471064:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e7fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1786400943.471378:0:6615:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b51393ef reply state 00000000e5d4d5dc transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e7fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400943.471389:0:6615:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1786400943.471500:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee353800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+21:11603:x1873176850167808:12345-192.168.204.8@tcp:36:lhsmtool_posix.0 Request processed in 623us (890us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1786400943.471508:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 228 00010000:00010000:3.0:1786400943.474261:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e7fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400943.474280:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e7fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400943.474289:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e7fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400943.474295:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138e600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786400943.474300:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e7fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400943.474325:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e7fe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400943.474342:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d6fc90cd600) 00010000:00010000:3.0:1786400943.474344:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786400943.474348:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e7fe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400943.474354:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e7fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400943.475388:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400943.476074:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850167936 00000100:00100000:0.0:1786400943.476102:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850167936 00000100:00100000:0.0:1786400943.476159:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 70 00000100:00100000:0.0:1786400943.476169:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+7:2364:x1873176850167936:12345-192.168.204.8@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1786400943.476400:0:6593:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1786400943.476403:0:6593:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1786400942 -> 1786400940 00002000:00010000:0.0:1786400943.476406:0:6593:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1786400940 00002000:00010000:0.0:1786400943.476408:0:6593:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1786400942 -> 1786400940 00002000:00010000:0.0:1786400943.476411:0:6593:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1786400943.476473:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+8:2364:x1873176850167936:12345-192.168.204.8@tcp:2:lhsmtool_posix.0 Request processed in 304us (1090us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1786400943.476481:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 70 00000100:00100000:0.0:1786400943.483249:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400943.483414:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850168192 00000100:00100000:2.0:1786400943.483425:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850168192 00000100:00100000:2.0:1786400943.483615:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 229 00000100:00100000:2.0:1786400943.483625:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff69b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+20:11603:x1873176850168192:12345-192.168.204.8@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1786400943.483694:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb600/0x5ccaaf4f3cb1e805 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.483711:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e7bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bea6 expref: 20 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.483720:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb600/0x5ccaaf4f3cb1e805 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.483783:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e7bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bea6 expref: 20 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.483797:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e7bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bea6 expref: 20 pid: 5788 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400943.483811:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee1be680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5790:1873176872167424:192.168.204.8@tcp:104: 00000100:00100000:2.0:1786400943.483898:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff6ec9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1786400943.488851:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400943.488913:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee1be680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5790:1873176872167424:192.168.204.8@tcp:104: 00010000:00010000:3.0:1786400943.489218:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb600/0x5ccaaf4f3cb1e805 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400943.489309:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850168320 00000100:00100000:0.0:1786400943.489332:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850168320 00010000:00010000:0.0:1786400943.489370:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e7bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bea6 expref: 21 pid: 5788 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400943.489409:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 83 00000100:00100000:0.0:1786400943.489419:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee351f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096c63d9-38b8-441b-8c71-343db25fe88a+21:2365:x1873176850168320:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786400943.489434:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400943.489441:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e7bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bea6 expref: 21 pid: 5788 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.489452:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e7bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bea6 expref: 21 pid: 5788 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.489473:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1e7bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bea6 expref: 21 pid: 5788 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.489488:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d6fc90cd600) 00010000:00010000:0.0:1786400943.489492:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb600/0x5ccaaf4f3cb1e805 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.489502:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb600/0x5ccaaf4f3cb1e805 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.489578:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb600/0x5ccaaf4f3cb1e805 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.489603:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400943.489652:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee351f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096c63d9-38b8-441b-8c71-343db25fe88a+20:2365:x1873176850168320:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 234us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400943.489669:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 83 00010000:00010000:0.0:1786400943.489780:0:5790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb600/0x5ccaaf4f3cb1e805 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.489788:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb600/0x5ccaaf4f3cb1e805 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.489818:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb600/0x5ccaaf4f3cb1e805 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.489823:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb600/0x5ccaaf4f3cb1e805 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.489829:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb600/0x5ccaaf4f3cb1e805 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.489835:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1bb600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400943.489839:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb600/0x5ccaaf4f3cb1e805 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.489845:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb600/0x5ccaaf4f3cb1e805 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.489853:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d6fc90cd600) 00010000:00010000:0.0:1786400943.489855:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1786400943.489858:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb600/0x5ccaaf4f3cb1e805 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.489863:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb600/0x5ccaaf4f3cb1e805 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400943.489916:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff69b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+19:11603:x1873176850168192:12345-192.168.204.8@tcp:55:lhsmtool_posix.0 Request processed in 6292us (6829us total) trans 0 rc -22/-22 00000100:00100000:0.0:1786400943.490003:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 229 00000100:00100000:3.0:1786400943.494639:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400943.494899:0:11770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850168448 00000100:00100000:2.0:1786400943.494910:0:11770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850168448 00000100:00100000:2.0:1786400943.495044:0:11770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 71 00000100:00100000:2.0:1786400943.495055:0:11770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee350380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:096c63d9-38b8-441b-8c71-343db25fe88a+8:2362:x1873176850168448:12345-192.168.204.8@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1786400943.495137:0:11770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c7896a5f/0x5ccaaf4f3cb1e80c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.495159:0:11770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005bd7a053/0x5ccaaf4f3cb1e7e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bec2 expref: 8 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.495168:0:11770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786400943.495172:0:11770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1786400943.495176:0:11770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7896a5f/0x5ccaaf4f3cb1e80c lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.495215:0:11770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005bd7a053/0x5ccaaf4f3cb1e7e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bec2 expref: 8 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.495251:0:11770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005bd7a053/0x5ccaaf4f3cb1e7e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bec2 expref: 8 pid: 6592 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400943.495266:0:11770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee1be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11770:1873176872167552:192.168.204.8@tcp:104: 00000100:00100000:2.0:1786400943.495348:0:11770:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff6ec9900 going to sleep for 11 seconds 00000100:00100000:2.0:1786400943.498611:0:11770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee1be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11770:1873176872167552:192.168.204.8@tcp:104: 00010000:00010000:2.0:1786400943.498643:0:11770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c7896a5f/0x5ccaaf4f3cb1e80c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400943.500237:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400943.500790:0:8369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850168576 00000100:00100000:1.0:1786400943.500813:0:8369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850168576 00010000:00010000:1.0:1786400943.500854:0:8369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005bd7a053/0x5ccaaf4f3cb1e7e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bec2 expref: 9 pid: 6592 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400943.500900:0:8369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 84 00000100:00100000:1.0:1786400943.500909:0:8369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee353b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+9:2364:x1873176850168576:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400943.500937:0:8369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400943.500962:0:8369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005bd7a053/0x5ccaaf4f3cb1e7e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bec2 expref: 9 pid: 6592 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.500975:0:8369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005bd7a053/0x5ccaaf4f3cb1e7e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bec2 expref: 9 pid: 6592 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.500999:0:8369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bd7a053/0x5ccaaf4f3cb1e7e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bec2 expref: 9 pid: 6592 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.501017:0:8369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786400943.501022:0:8369:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786400943.501040:0:8369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7896a5f/0x5ccaaf4f3cb1e80c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.501050:0:8369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7896a5f/0x5ccaaf4f3cb1e80c lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.501128:0:8369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400943.501185:0:8369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee353b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+8:2364:x1873176850168576:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 276us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400943.501201:0:8369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 84 00010000:00010000:2.0:1786400943.502453:0:11770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c7896a5f/0x5ccaaf4f3cb1e80c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.502469:0:11770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7896a5f/0x5ccaaf4f3cb1e80c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.502502:0:11770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c7896a5f/0x5ccaaf4f3cb1e80c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.502522:0:11770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7896a5f/0x5ccaaf4f3cb1e80c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.502531:0:11770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7896a5f/0x5ccaaf4f3cb1e80c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.502557:0:11770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1bb800 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:2.0:1786400943.502562:0:11770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7896a5f/0x5ccaaf4f3cb1e80c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.502572:0:11770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7896a5f/0x5ccaaf4f3cb1e80c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.502587:0:11770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7896a5f/0x5ccaaf4f3cb1e80c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.502596:0:11770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7896a5f/0x5ccaaf4f3cb1e80c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400943.502683:0:11770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee350380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:096c63d9-38b8-441b-8c71-343db25fe88a+7:2362:x1873176850168448:12345-192.168.204.8@tcp:1:lhsmtool_posix.0 Request processed in 7627us (8052us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400943.502691:0:11770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 71 00000100:00100000:3.0:1786400943.507772:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400943.508299:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850168832 00000100:00100000:2.0:1786400943.508310:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850168832 00000100:00100000:2.0:1786400943.508380:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 230 00000100:00100000:2.0:1786400943.508391:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+19:11603:x1873176850168832:12345-192.168.204.8@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1786400943.508475:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e813 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.508494:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e813 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.508953:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e813 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.510125:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb800/0x5ccaaf4f3cb1e81a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.510145:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e7cd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bead expref: 20 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.510153:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb800/0x5ccaaf4f3cb1e81a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.510191:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e7cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bead expref: 20 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.510205:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e7cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bead expref: 20 pid: 5788 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400943.510220:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee1be680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5789:1873176872167680:192.168.204.8@tcp:104: 00000100:00100000:2.0:1786400943.510321:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff6ec9900 going to sleep for 11 seconds 00000100:00100000:0.0:1786400943.514297:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400943.514424:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee1be680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5789:1873176872167680:192.168.204.8@tcp:104: 00010000:00010000:2.0:1786400943.514453:0:5789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb800/0x5ccaaf4f3cb1e81a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400943.514593:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850168960 00000100:00100000:1.0:1786400943.514601:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850168960 00010000:00010000:1.0:1786400943.514639:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e7cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bead expref: 21 pid: 5788 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400943.514858:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 85 00000100:00100000:1.0:1786400943.514868:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff69b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096c63d9-38b8-441b-8c71-343db25fe88a+21:2365:x1873176850168960:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400943.514886:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400943.514893:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e7cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bead expref: 21 pid: 5788 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.514906:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e7cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bead expref: 21 pid: 5788 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.515073:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab200/0x5ccaaf4f3cb1e7cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bead expref: 21 pid: 5788 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.515134:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d6fc90cd600) 00010000:00010000:1.0:1786400943.515140:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb800/0x5ccaaf4f3cb1e81a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.515150:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb800/0x5ccaaf4f3cb1e81a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.515158:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb800/0x5ccaaf4f3cb1e81a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.515205:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400943.515257:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff69b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096c63d9-38b8-441b-8c71-343db25fe88a+20:2365:x1873176850168960:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 390us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400943.515266:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 85 00010000:00010000:2.0:1786400943.515772:0:5789:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb800/0x5ccaaf4f3cb1e81a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.515782:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb800/0x5ccaaf4f3cb1e81a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786400943.515992:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1786400943.516183:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1786400943.516946:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1786400943.517054:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee1be680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5789:1873176872167808:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1786400943.517132:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400943.517168:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff6ec9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1786400943.517425:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872167808 00000100:00100000:3.0:1786400943.517433:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872167808 00000100:00100000:3.0:1786400943.517507:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1786400943.517612:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5789:x1873176872167808:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1786400943.517692:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5789:x1873176872167808:12345-0@lo:1000:mdt00_001.0 Request processed in 81us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400943.517698:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1786400943.517829:0:5789:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:0.0:1786400943.517835:0:5789:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:0.0:1786400943.517853:0:5789:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d6fc34c3b80, transno 4294967322 00000100:00100000:0.0:1786400943.517867:0:5789:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9d6ffdb87100 x1873176872166912/t4294967323(4294967323) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1786400959 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400943.517879:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee1be680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5789:1873176872167808:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1786400943.518316:0:5789:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1786400943.518373:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee1be680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5789:1873176872167936:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1786400943.518403:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400943.518623:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fee1f3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1786400943.518663:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872167936 00000100:00100000:2.0:1786400943.518668:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872167936 00000100:00100000:2.0:1786400943.518697:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1786400943.518705:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5789:x1873176872167936:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1786400943.518977:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5789:x1873176872167936:12345-0@lo:1000:mdt00_001.0 Request processed in 270us (569us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1786400943.518985:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1786400943.519080:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee1be680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5789:1873176872167936:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1786400943.519179:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb800/0x5ccaaf4f3cb1e81a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.519188:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb800/0x5ccaaf4f3cb1e81a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.519195:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb800/0x5ccaaf4f3cb1e81a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.519201:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1bb800 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400943.519204:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb800/0x5ccaaf4f3cb1e81a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.519222:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb800/0x5ccaaf4f3cb1e81a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.519237:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d6fc90cd600) 00010000:00010000:0.0:1786400943.519239:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786400943.519243:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb800/0x5ccaaf4f3cb1e81a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.519249:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb800/0x5ccaaf4f3cb1e81a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.519279:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e75d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.519285:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e75d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.519291:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e75d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.519295:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca091800 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786400943.519298:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e75d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.519303:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e75d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.519311:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:0.0:1786400943.519313:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1786400943.519320:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e764 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be91 expref: 23 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.519343:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e764 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be91 expref: 23 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.519352:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e764 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be91 expref: 23 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400943.519377:0:5789:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e764 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be91 expref: 23 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786400943.519387:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5fbe680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5789:1873176872168064:192.168.204.8@tcp:105: 00000100:00100000:0.0:1786400943.519453:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fee1f3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1786400943.527655:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400943.527752:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850169088 00000100:00100000:3.0:1786400943.527776:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850169088 00000100:00100000:3.0:1786400943.527835:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 61 00000100:00100000:3.0:1786400943.527846:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fe9204000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+24:11602:x1873176850169088:12345-192.168.204.8@tcp:49:lfs.0 00000100:00100000:3.0:1786400943.527997:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fe9204000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+24:11602:x1873176850169088:12345-192.168.204.8@tcp:49:lfs.0 Request processed in 152us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400943.528006:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 61 00000100:00100000:2.0:1786400943.530316:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5fbe680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5789:1873176872168064:192.168.204.8@tcp:105: 00010000:00010000:2.0:1786400943.530832:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e75d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.530844:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1e75d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.530880:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e821 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.530894:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e821 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.530905:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e821 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.530948:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e821 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.530953:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e821 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.530959:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e821 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.530965:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1bbc00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400943.530968:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e821 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.530975:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e821 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.530986:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:2.0:1786400943.530989:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400943.530992:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e821 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.530997:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e821 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.531006:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e813 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.531012:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e813 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.531017:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e813 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.531041:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1bbe00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400943.531044:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e813 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.531050:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e813 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.531059:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:2.0:1786400943.531061:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786400943.531064:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e813 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.531069:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e813 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400943.532042:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+23:11603:x1873176850168832:12345-192.168.204.8@tcp:57:lhsmtool_posix.0 Request processed in 23636us (24263us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1786400943.532054:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 230 00000020:00080000:2.0:1786400943.532061:0:5789:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1786400943.532358:0:11546:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786400943.532364:0:11546:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786400943.532823:0:11546:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1786400943.532831:0:11546:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1786400943.537056:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400943.537204:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850169344 00000100:00100000:3.0:1786400943.537215:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850169344 00000100:00100000:3.0:1786400943.537793:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 231 00000100:00100000:3.0:1786400943.537806:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+23:11602:x1873176850169344:12345-192.168.204.8@tcp:58:lfs.0 00000040:00080000:3.0:1786400943.538381:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1786400943.538471:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+23:11602:x1873176850169344:12345-192.168.204.8@tcp:58:lfs.0 Request processed in 666us (1424us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400943.538480:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 231 00000100:00100000:1.0:1786400943.542579:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400943.542928:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850169600 00000100:00100000:3.0:1786400943.542939:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850169600 00000100:00100000:3.0:1786400943.542991:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 62 00000100:00100000:3.0:1786400943.543001:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6d7c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+23:11603:x1873176850169600:12345-192.168.204.8@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1786400943.545434:0:5792:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1786400943.545586:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1786400943.545660:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e828 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400943.545688:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e828 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400943.548295:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e828 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400943.548315:0:5792:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e828 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400943.548322:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e828 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400943.548329:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e828 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400943.548412:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1786400943.548534:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6d7c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+25:11603:x1873176850169600:12345-192.168.204.8@tcp:35:lhsmtool_posix.0 Request processed in 5530us (5962us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1786400943.548544:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 62 00000020:00080000:3.0:1786400943.548550:0:5792:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1786400943.550433:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400943.550448:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e828 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.550458:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca090e00 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:2.0:1786400943.550462:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e828 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.550471:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e828 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.550509:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9d6fc5599700) 00010000:00010000:2.0:1786400943.550512:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1786400943.550517:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e828 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.550523:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1e828 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.550544:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400943.550547:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400943.550548:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400943.578825:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400943.579007:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850169728 00000100:00100000:0.0:1786400943.579018:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850169728 00000100:00100000:2.0:1786400943.579207:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 232 00000100:00100000:2.0:1786400943.579220:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+25:11605:x1873176850169728:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:2.0:1786400943.579243:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400943.579265:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e82f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bec9 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.579330:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e836 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.579344:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e836 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.579355:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e836 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.579370:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e83d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.579378:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e83d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.579399:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e83d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.579698:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba200/0x5ccaaf4f3cb1e844 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.579710:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1e74f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be8a expref: 26 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.579718:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba200/0x5ccaaf4f3cb1e844 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.580592:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1e74f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be8a expref: 26 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.580611:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1e74f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be8a expref: 26 pid: 5789 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786400943.580627:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5fbe680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5789:1873176872168192:192.168.204.8@tcp:104: 00000100:00100000:2.0:1786400943.581864:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff6ec9600 going to sleep for 11 seconds 00000100:00100000:2.0:1786400943.585793:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5fbe680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5789:1873176872168192:192.168.204.8@tcp:104: 00010000:00010000:2.0:1786400943.585825:0:5789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba200/0x5ccaaf4f3cb1e844 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400943.587819:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400943.588069:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850169984 00000100:00100000:3.0:1786400943.588080:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850169984 00000100:00100000:3.0:1786400943.588948:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 63 00000100:00100000:3.0:1786400943.588960:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+27:5577:x1873176850169984:12345-192.168.204.8@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1786400943.589246:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+28:5577:x1873176850169984:12345-192.168.204.8@tcp:35:ldlm_bl.0 Request processed in 287us (1436us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1786400943.589254:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 63 00000100:00100000:3.0:1786400943.594046:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400943.594569:0:8369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850170112 00000100:00100000:1.0:1786400943.594581:0:8369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850170112 00010000:00010000:1.0:1786400943.594626:0:8369:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1e74f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be8a expref: 28 pid: 5789 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400943.594719:0:8369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 86 00000100:00100000:1.0:1786400943.594730:0:8369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee352d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+28:2364:x1873176850170112:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400943.594757:0:8369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400943.594765:0:8369:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1e74f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be8a expref: 28 pid: 5789 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.594779:0:8369:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1e74f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be8a expref: 28 pid: 5789 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.594802:0:8369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1e74f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be8a expref: 28 pid: 5789 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.594818:0:8369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:1.0:1786400943.594824:0:8369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba200/0x5ccaaf4f3cb1e844 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.594840:0:8369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba200/0x5ccaaf4f3cb1e844 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.594847:0:8369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba200/0x5ccaaf4f3cb1e844 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400943.594885:0:8369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400943.594953:0:8369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee352d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096c63d9-38b8-441b-8c71-343db25fe88a+27:2364:x1873176850170112:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 223us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400943.594961:0:8369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 86 00010000:00010000:2.0:1786400943.595921:0:5789:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba200/0x5ccaaf4f3cb1e844 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.595932:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba200/0x5ccaaf4f3cb1e844 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400943.595986:0:5789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1786400943.595990:0:5789:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1786400943.596010:0:5789:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba200/0x5ccaaf4f3cb1e844 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.596023:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba200/0x5ccaaf4f3cb1e844 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.596046:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e836 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.596053:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e836 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.596060:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e836 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.596066:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1bbc00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400943.596071:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e836 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.596078:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e836 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.596125:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d6fc5599e00) 00010000:00010000:2.0:1786400943.596129:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400943.596133:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e836 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.596140:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e836 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.596164:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e83d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.596170:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e83d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.596175:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e83d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.596181:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1ba800 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786400943.596184:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e83d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.596190:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e83d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.596198:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9d6fd022ef00) 00010000:00010000:2.0:1786400943.596201:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786400943.596203:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e83d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.596210:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e83d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.596249:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e82f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bec9 expref: 27 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.596261:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba200/0x5ccaaf4f3cb1e844 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bec9 expref: 26 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400943.596278:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:2.0:1786400943.596281:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1786400943.596283:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fee1ba200, rc 0) 00000100:00100000:2.0:1786400943.596333:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+26:11605:x1873176850169728:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 17116us (17518us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400943.596340:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 232 00010000:00010000:3.0:1786400944.047353:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786400944.416912:0:12429:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1786400944.416924:0:12429:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786400944.420121:0:12429:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1786400944.420130:0:12429:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1786400944.558972:0:11546:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786400944.558982:0:11546:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786400944.559050:0:11546:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1786400944.559057:0:11546:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1786400944.559185:0:11546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee350700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11546:1873176872168320:192.168.204.8@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786400944.559287:0:11546:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffdbfb000 going to sleep for 11 seconds 00000100:00100000:3.0:1786400944.569586:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400944.569732:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850170240 00000100:00100000:2.0:1786400944.569741:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850170240 00000100:00100000:2.0:1786400944.569803:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 233 00000100:00100000:2.0:1786400944.569812:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+27:11617:x1873176850170240:12345-192.168.204.8@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1786400944.569848:0:5790:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1786400944.570190:0:11546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee350700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11546:1873176872168320:192.168.204.8@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1786400944.570541:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+26:11617:x1873176850170240:12345-192.168.204.8@tcp:53:lhsmtool_posix.0 Request processed in 728us (1578us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400944.570550:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 233 00000100:00080000:2.0:1786400944.571306:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400944.585624:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400944.586580:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850170496 00000100:00100000:0.0:1786400944.586592:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850170496 00000100:00100000:0.0:1786400944.586661:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 234 00000100:00100000:0.0:1786400944.586672:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc34c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+26:11617:x1873176850170496:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786400944.586695:0:6615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400944.586716:0:6615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e84b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bed0 expref: -99 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400944.588484:0:6615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1e852 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400944.588500:0:6615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1e852 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400944.588513:0:6615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1e852 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400944.588524:0:6615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1786400944.588791:0:6615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e84b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bed0 expref: 29 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400944.588811:0:6615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1e852 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bed0 expref: 28 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400944.588820:0:6615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:0.0:1786400944.588823:0:6615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786400944.588827:0:6615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5ab400, rc 0) 00000100:00100000:0.0:1786400944.588905:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc34c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+28:11617:x1873176850170496:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 2235us (3291us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1786400944.588915:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 234 00000100:00100000:0.0:1786400944.596864:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400944.596908:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400944.596935:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850170624 00000100:00100000:0.0:1786400944.596944:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850170624 00000100:00100000:0.0:1786400944.597003:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 17 00000100:00100000:0.0:1786400944.597026:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc35dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096c63d9-38b8-441b-8c71-343db25fe88a+28:2365:x1873176850170624:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786400944.597051:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400944.597075:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1e852 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bed0 expref: 28 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400944.597115:0:5774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:0.0:1786400944.597120:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400944.597175:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc35dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096c63d9-38b8-441b-8c71-343db25fe88a+27:2365:x1873176850170624:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 151us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400944.597183:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 17 00000100:00100000:1.0:1786400944.597444:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850170880 00000100:00100000:1.0:1786400944.597450:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850170880 00000100:00100000:1.0:1786400944.597488:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 235 00000100:00100000:1.0:1786400944.597495:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee30c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+27:11617:x1873176850170880:12345-192.168.204.8@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1786400944.597571:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e860 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400944.597588:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e860 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400944.597600:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e860 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400944.599952:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e860 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400944.599971:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e860 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400944.599993:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e860 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400944.599998:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138fa00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786400944.600003:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e860 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400944.600026:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e860 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400944.600046:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:1.0:1786400944.600049:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1786400944.600054:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e860 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400944.600060:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1e860 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400944.600233:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee30c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+28:11617:x1873176850170880:12345-192.168.204.8@tcp:57:lhsmtool_posix.0 Request processed in 2733us (3373us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1786400944.600243:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 235 00000040:00080000:3.0:1786400944.600456:0:11546:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786400944.600461:0:11546:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786400944.601049:0:11546:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1786400944.601058:0:11546:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786400944.604621:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400944.605833:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850171136 00000100:00100000:3.0:1786400944.605845:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850171136 00000100:00100000:3.0:1786400944.605908:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 64 00000100:00100000:3.0:1786400944.605919:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+28:11617:x1873176850171136:12345-192.168.204.8@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1786400944.606199:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+29:11617:x1873176850171136:12345-192.168.204.8@tcp:35:lhsmtool_posix.0 Request processed in 281us (1588us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1786400944.606207:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 64 00000100:00100000:0.0:1786400944.879129:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1786400944.879524:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5fbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872168448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786400944.879598:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400944.880738:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872168448 00000100:00100000:1.0:1786400944.880749:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872168448 00000100:00100000:1.0:1786400944.881118:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1786400944.881129:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee30e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1873176872168448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786400944.881168:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400944.881241:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee30e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1873176872168448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (1642us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400944.881512:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1786400944.881747:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5fbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872168448:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1786400945.070317:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400945.200957:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400945.201256:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850171264 00000100:00100000:0.0:1786400945.201267:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850171264 00000100:00100000:0.0:1786400945.201557:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 294 00000100:00100000:0.0:1786400945.201568:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2364:x1873176850171264:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786400945.201652:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2364:x1873176850171264:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 85us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400945.201660:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 294 00000100:00100000:3.0:1786400945.202861:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400945.202930:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400945.203056:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850171520 00000100:00100000:2.0:1786400945.203065:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850171520 00000100:00100000:2.0:1786400945.203155:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 64 00000100:00100000:2.0:1786400945.203167:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee351f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+5:2364:x1873176850171520:12345-192.168.204.8@tcp:400:kworker.0 00000100:00080000:3.0:1786400945.203236:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786400945.203236:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee351f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+5:2364:x1873176850171520:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 71us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400945.203251:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 64 00000100:00100000:1.0:1786400945.203916:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850171392 00000100:00100000:1.0:1786400945.203923:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850171392 00000100:00100000:1.0:1786400945.203973:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 153 00000100:00100000:1.0:1786400945.203982:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+29:2364:x1873176850171392:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:1.0:1786400945.204057:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+29:2364:x1873176850171392:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 76us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400945.204063:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 153 00000100:00100000:3.0:1786400945.206059:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400945.206338:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850171648 00000100:00100000:0.0:1786400945.206352:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850171648 00000100:00100000:0.0:1786400945.206686:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 65 00000100:00100000:0.0:1786400945.206698:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+7:2364:x1873176850171648:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786400945.206783:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee353b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+7:2364:x1873176850171648:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 88us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400945.206804:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 65 00000100:00080000:3.0:1786400945.207818:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786400945.211255:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400945.211839:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850171776 00000100:00100000:0.0:1786400945.211849:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850171776 00000100:00100000:0.0:1786400945.212122:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 154 00000100:00100000:0.0:1786400945.212133:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee352d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2365:x1873176850171776:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786400945.212486:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee352d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2365:x1873176850171776:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 354us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400945.212495:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 154 00000100:00080000:3.0:1786400945.212754:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400945.393156:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873176872168704:0@lo:400:kworker.0 00000100:00100000:1.0:1786400945.393240:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400945.393349:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5fbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:97b0324f-e214-4822-8711-e150ddac2a7e:3307:1873176872168576:0@lo:400:kworker.0 00000100:00100000:0.0:1786400945.393388:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400945.393506:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786400945.393515:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873176872168832:0@lo:400:kworker.0 00000100:00100000:1.0:1786400945.393543:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400945.393580:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872168704 00000100:00100000:1.0:1786400945.393588:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872168704 00000100:00100000:1.0:1786400945.393630:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872168832 00000100:00100000:1.0:1786400945.393633:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872168832 00000100:00100000:1.0:1786400945.393664:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1786400945.393672:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873176872168704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400945.393724:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873176872168704:12345-0@lo:400:kworker.0 Request processed in 53us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400945.393732:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1786400945.393748:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1786400945.393754:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873176872168832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400945.393780:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873176872168832:12345-0@lo:400:kworker.0 Request processed in 27us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400945.393800:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1786400945.393847:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873176872168832:0@lo:400:kworker.0 00000100:00100000:1.0:1786400945.393858:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873176872168704:0@lo:400:kworker.0 00000100:00100000:3.0:1786400945.394063:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873176872168960:0@lo:400:kworker.0 00000100:00100000:3.0:1786400945.394113:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400945.394140:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786400945.394147:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fee350700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872169216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786400945.394174:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400945.394199:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872169216 00000100:00100000:3.0:1786400945.394203:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872169216 00000100:00100000:3.0:1786400945.394235:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1786400945.394242:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fe9204000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1873176872169216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786400945.394272:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786400945.394307:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fe9204000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1873176872169216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400945.394313:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1786400945.394342:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fee350700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872169216:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1786400945.394359:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786400945.394364:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400945.394371:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872168960 00000100:00100000:3.0:1786400945.394374:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872168960 00000100:00100000:3.0:1786400945.394398:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1786400945.394404:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873176872168960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400945.394435:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873176872168960:12345-0@lo:400:kworker.0 Request processed in 32us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400945.394441:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1786400945.394464:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873176872168960:0@lo:400:kworker.0 00000100:00080000:3.0:1786400945.394482:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786400945.394612:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872168576 00000100:00100000:2.0:1786400945.394626:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872168576 00000100:00100000:2.0:1786400945.394702:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1786400945.394709:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+19:3307:x1873176872168576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400945.394743:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+19:3307:x1873176872168576:12345-0@lo:400:kworker.0 Request processed in 35us (1355us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400945.394749:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1786400945.394851:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5fbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:97b0324f-e214-4822-8711-e150ddac2a7e:3307:1873176872168576:0@lo:400:kworker.0 00000100:00100000:0.0:1786400945.394860:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872169088:0@lo:400:kworker.0 00000100:00100000:0.0:1786400945.394885:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400945.394982:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872169088 00000100:00100000:3.0:1786400945.395003:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872169088 00000100:00100000:3.0:1786400945.395036:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1786400945.395043:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee30ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1873176872169088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400945.395077:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee30ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1873176872169088:12345-0@lo:400:kworker.0 Request processed in 35us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400945.395083:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1786400945.395173:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872169088:0@lo:400:kworker.0 00010000:00010000:3.0:1786400946.094441:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1786400946.425238:0:12480:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1786400946.425250:0:12480:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1786400946.425306:0:12480:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1786400946.425312:0:12480:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1786400946.626634:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400946.627261:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850172032 00000100:00100000:2.0:1786400946.627275:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850172032 00000100:00100000:2.0:1786400946.627405:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 236 00000100:00100000:2.0:1786400946.627417:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+29:11638:x1873176850172032:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:2.0:1786400946.627438:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786400946.627461:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e867 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bed7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400946.627571:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb000/0x5ccaaf4f3cb1e86e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400946.627592:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb000/0x5ccaaf4f3cb1e86e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400946.627605:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb000/0x5ccaaf4f3cb1e86e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786400946.627617:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1786400946.627756:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1e867 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bed7 expref: 32 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400946.627793:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb000/0x5ccaaf4f3cb1e86e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bed7 expref: 31 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400946.627802:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:2.0:1786400946.627805:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1786400946.627810:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fee1bb000, rc 0) 00000100:00100000:2.0:1786400946.627897:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+31:11638:x1873176850172032:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 483us (1275us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1786400946.627906:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 236 00000100:00080000:0.0:1786400946.631389:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786400946.634891:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400946.635011:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850172160 00000100:00100000:3.0:1786400946.635023:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850172160 00000100:00100000:3.0:1786400946.638162:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 237 00000100:00100000:3.0:1786400946.638192:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+31:11638:x1873176850172160:12345-192.168.204.8@tcp:54:lfs.0 00010000:00010000:3.0:1786400946.638272:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e87c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400946.638291:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e87c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400946.638304:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e87c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400946.638336:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e87c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400946.638343:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e87c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400946.638350:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e87c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400946.638356:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca090c00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786400946.638360:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e87c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400946.638381:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e87c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400946.638394:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:3.0:1786400946.638397:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786400946.638402:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e87c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400946.638408:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e87c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5789 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786400946.638509:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:096c63d9-38b8-441b-8c71-343db25fe88a+31:11638:x1873176850172160:12345-192.168.204.8@tcp:54:lfs.0 Request processed in 331us (3629us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400946.638517:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 237 00000100:00100000:3.0:1786400946.752247:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400946.752616:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850172288 00000100:00100000:0.0:1786400946.752626:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850172288 00000100:00100000:0.0:1786400946.752734:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 72 00000100:00100000:0.0:1786400946.752745:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee350700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+7:2362:x1873176850172288:12345-192.168.204.8@tcp:101:cat.0 00010000:00010000:0.0:1786400946.752767:0:6592:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400946.752793:0:6592:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1a88f7b/0x5ccaaf4f3cb1e883 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bede expref: -99 pid: 6592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786400946.752821:0:6592:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a7a50ac, atime: 0x6a7a50ac, ctime: 0x6a7a50ac, blocks: 0xb 00010000:00010000:0.0:1786400946.752859:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=399s v=(0 0) 00010000:00010000:0.0:1786400946.752863:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786400946.752873:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1a88f7b/0x5ccaaf4f3cb1e883 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bede expref: 8 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400946.752892:0:6592:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e1a88f7b/0x5ccaaf4f3cb1e883 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bede expref: 8 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400946.752906:0:6592:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5ab600, rc 0) 00000100:00100000:0.0:1786400946.753299:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee350700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:096c63d9-38b8-441b-8c71-343db25fe88a+8:2362:x1873176850172288:12345-192.168.204.8@tcp:101:cat.0 Request processed in 554us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400946.753307:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 72 00000100:00100000:1.0:1786400946.760217:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400946.760401:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850172416 00000100:00100000:3.0:1786400946.760414:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850172416 00002000:00100000:3.0:1786400946.760476:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9d6ff5f98380 x1873176850172416/t0(0) o3->096c63d9-38b8-441b-8c71-343db25fe88a@192.168.204.8@tcp:742/0 lens 488/0 e 0 to 0 dl 1786400957 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786400946.760489:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ff5f98380 with x1873176850172416 ext(0->4095) 00002000:00010000:3.0:1786400946.760496:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d6ff5f98380 00000100:00100000:3.0:1786400946.760535:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 8 00000100:00100000:3.0:1786400946.760545:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:096c63d9-38b8-441b-8c71-343db25fe88a+8:2363:x1873176850172416:12345-192.168.204.8@tcp:3:cat.0 00000100:00100000:3.0:1786400946.760775:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:096c63d9-38b8-441b-8c71-343db25fe88a+8:2363:x1873176850172416:12345-192.168.204.8@tcp:3:cat.0 Request processed in 231us (570us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1786400946.760784:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 8 00002000:00100000:3.0:1786400946.760791:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9d6ff5f98380 x1873176850172416/t0(0) o3->096c63d9-38b8-441b-8c71-343db25fe88a@192.168.204.8@tcp:742/0 lens 488/4536 e 0 to 0 dl 1786400957 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1786400946.760813:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ff5f98380 with x1873176850172416 ext(0->4095) 00002000:00010000:3.0:1786400946.760817:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d6ff5f98380 00000001:00080000:1.0:1786400947.030463:0:6619:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:2.0:1786400947.118898:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400948.144171:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1786400948.569327:0:5810:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967516 is committed 00000020:00080000:1.0:1786400948.569432:0:5810:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d6fee1f3e40 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1786400948.569439:0:5810:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d6ff5fa0b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d6fee1f3540 00000020:00080000:1.0:1786400948.569444:0:5810:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d6ff5fa0700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d6fedca2000 00000001:00080000:1.0:1786400948.569481:0:5810:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000001:00080000:1.0:1786400948.569504:0:5810:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1786400948.569607:0:5810:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1786400948.569652:0:5822:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1786400948.570040:0:5822:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:3.0:1786400948.576624:0:7501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:3.0:1786400948.576855:0:7501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00010000:00010000:2.0:1786400949.168351:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400949.998627:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786400949.998657:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd59aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872169344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786400949.998744:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400949.999577:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872169344 00000100:00100000:2.0:1786400949.999678:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872169344 00000100:00100000:2.0:1786400949.999755:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1786400949.999766:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd59b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872169344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786400950.000201:0:6594:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786400950.000284:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd59b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872169344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 519us (1539us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400950.000293:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1786400950.000503:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786400950.002457:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1786400950.002473:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d6ff69b6d80, transno 4294967310 00000100:00100000:3.0:1786400950.002509:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd59aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872169344:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1786400950.191329:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400950.328696:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400950.329556:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400950.329595:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400950.329724:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850172672 00000100:00100000:2.0:1786400950.329736:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850172672 00000100:00100000:3.0:1786400950.329824:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400950.330016:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400950.330067:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850173056 00000100:00100000:3.0:1786400950.330075:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850173056 00000100:00100000:2.0:1786400950.330138:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 158 00000100:00100000:2.0:1786400950.330154:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd59aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+18:2363:x1873176850172672:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:3.0:1786400950.330176:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 159 00000100:00100000:3.0:1786400950.330189:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdb87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2363:x1873176850173056:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:2.0:1786400950.330248:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd59aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:096c63d9-38b8-441b-8c71-343db25fe88a+18:2363:x1873176850172672:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 97us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400950.330260:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdb87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2363:x1873176850173056:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 72us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400950.330284:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 159 00000100:00080000:3.0:1786400950.330374:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786400950.330476:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 158 00000100:00100000:2.0:1786400950.330540:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850172800 00000100:00100000:2.0:1786400950.330546:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850172800 00000100:00100000:2.0:1786400950.330589:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850172928 00000100:00100000:2.0:1786400950.330592:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850172928 00000100:00100000:2.0:1786400950.330615:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 67 00000100:00100000:2.0:1786400950.330622:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+5:2363:x1873176850172800:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:2.0:1786400950.330660:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd599180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+5:2363:x1873176850172800:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 38us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400950.330667:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 67 00000100:00100000:2.0:1786400950.330680:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 68 00000100:00100000:2.0:1786400950.330686:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdb85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+7:2363:x1873176850172928:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:2.0:1786400950.330710:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdb85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:096c63d9-38b8-441b-8c71-343db25fe88a+7:2363:x1873176850172928:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 24us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400950.330717:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 68 00000100:00080000:3.0:1786400950.331387:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786400950.331394:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786400950.331599:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850172544 00000100:00100000:0.0:1786400950.331607:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850172544 00000100:00100000:2.0:1786400950.331827:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 296 00000100:00100000:2.0:1786400950.331836:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2363:x1873176850172544:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:2.0:1786400950.331901:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2363:x1873176850172544:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 57us (3206us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400950.331909:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 296 00000100:00100000:0.0:1786400950.510804:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd890380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873176872169728:0@lo:400:kworker.0 00000100:00100000:0.0:1786400950.510909:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400950.510976:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786400950.510983:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd890700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873176872169856:0@lo:400:kworker.0 00000100:00100000:0.0:1786400950.511008:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400950.511041:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872169728 00000100:00100000:0.0:1786400950.511055:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872169728 00000100:00100000:0.0:1786400950.511132:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872169856 00000100:00100000:0.0:1786400950.511136:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872169856 00000100:00100000:0.0:1786400950.511158:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1786400950.511166:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff69b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873176872169728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400950.511219:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff69b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873176872169728:12345-0@lo:400:kworker.0 Request processed in 54us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400950.511236:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1786400950.511253:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1786400950.511259:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff69b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873176872169856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400950.511286:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff69b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873176872169856:12345-0@lo:400:kworker.0 Request processed in 28us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400950.511292:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1786400950.511328:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd890700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873176872169856:0@lo:400:kworker.0 00000100:00100000:0.0:1786400950.511338:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd890380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873176872169728:0@lo:400:kworker.0 00000100:00080000:0.0:1786400950.511367:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400950.513423:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdb85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:97b0324f-e214-4822-8711-e150ddac2a7e:3306:1873176872169472:0@lo:400:kworker.0 00000100:00100000:1.0:1786400950.513497:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400950.513547:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd893b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872169984:0@lo:400:kworker.0 00000100:00100000:1.0:1786400950.513573:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400950.513602:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1786400950.513608:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc9269c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872169600:0@lo:400:kworker.0 00000100:00100000:1.0:1786400950.513648:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400950.513670:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5fbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872170112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1786400950.513693:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400950.513731:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872170112 00000100:00100000:1.0:1786400950.513738:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872170112 00000100:00100000:1.0:1786400950.513784:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1786400950.513792:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872170112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786400950.513827:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786400950.513869:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872170112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400950.513876:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1786400950.513911:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872169600 00000100:00100000:1.0:1786400950.513914:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872169600 00000100:00100000:1.0:1786400950.513936:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1786400950.513941:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872169600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400950.513969:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872169600:12345-0@lo:400:kworker.0 Request processed in 27us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400950.513975:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1786400950.514004:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc9269c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872169600:0@lo:400:kworker.0 00000100:00100000:1.0:1786400950.514012:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:1.0:1786400950.514017:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d6ffdb87100, transno 4294967323 00000004:00080000:1.0:1786400950.514026:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:1.0:1786400950.514048:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5fbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872170112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786400950.517268:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872169472 00000100:00100000:3.0:1786400950.517284:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872169472 00000100:00100000:3.0:1786400950.517352:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1786400950.517363:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+19:3306:x1873176872169472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400950.517446:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:97b0324f-e214-4822-8711-e150ddac2a7e+19:3306:x1873176872169472:12345-0@lo:400:kworker.0 Request processed in 86us (3949us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400950.517453:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1786400950.520318:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872169984 00000100:00100000:2.0:1786400950.520331:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872169984 00000100:00100000:2.0:1786400950.521924:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1786400950.521943:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872169984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400950.522053:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872169984:12345-0@lo:400:kworker.0 Request processed in 117us (8478us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400950.522062:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1786400950.522128:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786400950.522355:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdb85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:97b0324f-e214-4822-8711-e150ddac2a7e:3306:1873176872169472:0@lo:400:kworker.0 00000100:00100000:1.0:1786400950.522372:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd893b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872169984:0@lo:400:kworker.0 00000040:00080000:3.0:1786400950.766863:0:11546:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1786400950.766874:0:11546:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1786400950.766930:0:11546:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1786400950.766937:0:11546:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1786400951.214962:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400952.239535:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400952.300060:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400952.301054:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850173184 00000100:00100000:0.0:1786400952.301071:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850173184 00000100:00100000:0.0:1786400952.301195:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 238 00000100:00100000:0.0:1786400952.301209:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+18:11290:x1873176850173184:12345-192.168.204.8@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1786400952.301375:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+18:11290:x1873176850173184:12345-192.168.204.8@tcp:60:lhsmtool_posix.0 Request processed in 169us (1328us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400952.301385:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 238 00000100:00080000:2.0:1786400952.303068:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400952.306499:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400952.308947:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850173440 00000100:00100000:1.0:1786400952.308969:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850173440 00000100:00100000:1.0:1786400952.309155:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 65 00000100:00100000:1.0:1786400952.309169:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff69b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+18:11290:x1873176850173440:12345-192.168.204.8@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1786400952.309843:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff69b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+19:11290:x1873176850173440:12345-192.168.204.8@tcp:35:lhsmtool_posix.0 Request processed in 671us (3353us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1786400952.309863:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 65 00000100:00100000:3.0:1786400952.598827:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400952.599028:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850173568 00000100:00100000:0.0:1786400952.599038:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850173568 00000100:00100000:0.0:1786400952.599142:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 239 00000100:00100000:0.0:1786400952.599151:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd892300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:12090:x1873176850173568:12345-192.168.204.8@tcp:101:lsof.0 00010000:00010000:0.0:1786400952.599169:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786400952.599187:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e88a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bee5 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400952.599259:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e891 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400952.599271:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e891 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400952.599282:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e891 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786400952.599469:0:5788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1786400952.599474:0:5788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1786400952.599557:0:5788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e891 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400952.599583:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1e88a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bee5 expref: 7 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400952.599600:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e891 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bee5 expref: 6 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400952.599608:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fc5599b00) 00010000:00010000:0.0:1786400952.599610:0:5788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786400952.599614:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5aa400, rc 0) 00000100:00100000:0.0:1786400952.600693:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd892300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+6:12090:x1873176850173568:12345-192.168.204.8@tcp:101:lsof.0 Request processed in 1538us (1871us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400952.600703:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 239 00000100:00080000:2.0:1786400952.601627:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1786400953.262900:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1786400953.639315:0:5810:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1786400953.639338:0:5810:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1786400953.639474:0:5822:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1786400953.639486:0:5822:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1786400954.286474:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400955.118540:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1786400955.118563:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872170240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786400955.118628:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400955.118684:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872170240 00000100:00100000:3.0:1786400955.118692:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872170240 00000100:00100000:3.0:1786400955.118743:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1786400955.118751:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd893100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872170240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786400955.118783:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786400955.120309:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd893100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872170240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1551us (1673us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400955.120322:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1786400955.120389:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786400955.120436:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872170240:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1786400955.310766:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400955.448751:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400955.449125:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850173696 00000100:00100000:1.0:1786400955.449141:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850173696 00000100:00100000:1.0:1786400955.449216:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 298 00000100:00100000:1.0:1786400955.449229:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2365:x1873176850173696:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:1.0:1786400955.449330:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2365:x1873176850173696:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 103us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400955.449339:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 298 00000100:00100000:3.0:1786400955.464405:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400955.465134:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850173824 00000100:00100000:0.0:1786400955.465164:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850173824 00000100:00100000:0.0:1786400955.465246:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 163 00000100:00100000:0.0:1786400955.465259:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd891880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+18:2365:x1873176850173824:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786400955.465361:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd891880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:096c63d9-38b8-441b-8c71-343db25fe88a+18:2365:x1873176850173824:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 105us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400955.465369:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 163 00000100:00080000:3.0:1786400955.465939:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400955.497309:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400955.497350:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400955.497386:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400955.497419:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850174080 00000100:00100000:3.0:1786400955.497432:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850174080 00000100:00100000:3.0:1786400955.497503:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850173952 00000100:00100000:3.0:1786400955.497506:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850173952 00000100:00100000:3.0:1786400955.497551:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 70 00000100:00100000:3.0:1786400955.497563:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+7:2364:x1873176850174080:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:3.0:1786400955.497660:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+7:2364:x1873176850174080:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 99us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400955.497668:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 70 00000100:00100000:3.0:1786400955.497975:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 71 00000100:00100000:3.0:1786400955.497983:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd891c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+5:2364:x1873176850173952:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:3.0:1786400955.498015:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd891c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+5:2364:x1873176850173952:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 33us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400955.498021:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 71 00000100:00080000:3.0:1786400955.498042:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786400955.498047:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786400955.499242:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850174208 00000100:00100000:0.0:1786400955.499255:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850174208 00000100:00100000:0.0:1786400955.499333:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 164 00000100:00100000:0.0:1786400955.499344:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+6:2364:x1873176850174208:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786400955.499580:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+6:2364:x1873176850174208:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 237us (2191us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400955.499587:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 164 00000100:00080000:3.0:1786400955.500210:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400955.631574:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd893800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872170496:0@lo:400:kworker.0 00000100:00100000:1.0:1786400955.631672:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400955.631982:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd891500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:97b0324f-e214-4822-8711-e150ddac2a7e:3309:1873176872170368:0@lo:400:kworker.0 00000100:00100000:2.0:1786400955.632028:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400955.632117:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd892680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873176872170880:0@lo:400:kworker.0 00000100:00100000:2.0:1786400955.632150:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872170752:0@lo:400:kworker.0 00000100:00100000:2.0:1786400955.632179:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400955.632222:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd890e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1873176872170624:0@lo:400:kworker.0 00000100:00100000:2.0:1786400955.632256:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872170368 00000100:00100000:2.0:1786400955.632265:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872170368 00000100:00100000:2.0:1786400955.632318:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1786400955.632328:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+19:3309:x1873176872170368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400955.632386:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:97b0324f-e214-4822-8711-e150ddac2a7e+19:3309:x1873176872170368:12345-0@lo:400:kworker.0 Request processed in 59us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400955.632394:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1786400955.632432:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872170752 00000100:00100000:2.0:1786400955.632436:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872170752 00000100:00100000:2.0:1786400955.632464:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1786400955.632484:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872170752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400955.632524:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872170752:12345-0@lo:400:kworker.0 Request processed in 40us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400955.632530:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1786400955.632579:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872170752:0@lo:400:kworker.0 00000100:00100000:0.0:1786400955.634474:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872170496 00000100:00100000:0.0:1786400955.634492:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872170496 00000100:00100000:0.0:1786400955.634560:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1786400955.634570:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6fe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872170496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400955.634728:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400955.634874:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872171136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786400955.635027:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400955.635063:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786400955.635071:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd891f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872171008:0@lo:400:kworker.0 00000100:00100000:3.0:1786400955.635127:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400955.635162:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872171136 00000100:00100000:3.0:1786400955.635167:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872171136 00000100:00100000:3.0:1786400955.635214:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1786400955.635221:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd892d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872171136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786400955.635371:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786400955.635415:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd892d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872171136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 193us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400955.635423:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1786400955.635451:0:11770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872171008 00000100:00100000:3.0:1786400955.635455:0:11770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872171008 00000100:00100000:3.0:1786400955.635481:0:11770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1786400955.635487:0:11770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd890000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872171008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400955.635520:0:11770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd890000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872171008:12345-0@lo:400:kworker.0 Request processed in 33us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400955.635526:0:11770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1786400955.635544:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1786400955.635586:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd891f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872171008:0@lo:400:kworker.0 00000100:00100000:3.0:1786400955.635605:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872171136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786400955.635871:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786400955.635919:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd891500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:97b0324f-e214-4822-8711-e150ddac2a7e:3309:1873176872170368:0@lo:400:kworker.0 00000100:00100000:2.0:1786400955.635943:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872170624 00000100:00100000:2.0:1786400955.635947:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872170624 00000100:00100000:2.0:1786400955.636042:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872170880 00000100:00100000:2.0:1786400955.636046:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872170880 00000100:00100000:2.0:1786400955.636065:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1786400955.636071:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd892a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873176872170624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400955.636136:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd892a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873176872170624:12345-0@lo:400:kworker.0 Request processed in 65us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400955.636143:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1786400955.636158:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1786400955.636164:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873176872170880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786400955.636200:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873176872170880:12345-0@lo:400:kworker.0 Request processed in 36us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400955.636205:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1786400955.636561:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd892680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873176872170880:0@lo:400:kworker.0 00000100:00080000:2.0:1786400955.636586:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786400955.636609:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd890e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1873176872170624:0@lo:400:kworker.0 00000100:00100000:0.0:1786400955.639868:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6fe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872170496:12345-0@lo:400:kworker.0 Request processed in 4072us (6969us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400955.639895:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1786400955.641329:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd893800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872170496:0@lo:400:kworker.0 00000001:02000400:2.0:1786400956.005686:0:12683:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 18:29:12 (1786400952) 00010000:00010000:1.0:1786400956.335357:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400957.360174:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400958.382518:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400959.274964:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400959.275142:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850174464 00000100:00100000:1.0:1786400959.275157:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850174464 00000100:00100000:1.0:1786400959.275286:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 66 00000100:00100000:1.0:1786400959.275300:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+18:12311:x1873176850174464:12345-192.168.204.8@tcp:35:umount.0 00000100:00080000:2.0:1786400959.276710:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786400959.277015:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+19:12311:x1873176850174464:12345-192.168.204.8@tcp:35:umount.0 Request processed in 1711us (2061us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1786400959.277029:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 66 00000100:00100000:0.0:1786400959.281933:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400959.282133:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850174720 00000100:00100000:3.0:1786400959.282148:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850174720 00000100:00100000:3.0:1786400959.282274:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 67 00000100:00100000:3.0:1786400959.282288:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d7000dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+19:12311:x1873176850174720:12345-192.168.204.8@tcp:35:umount.0 00000100:00100000:3.0:1786400959.283055:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d7000dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+20:12311:x1873176850174720:12345-192.168.204.8@tcp:35:umount.0 Request processed in 766us (1133us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1786400959.283066:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 67 00000100:00100000:0.0:1786400959.286996:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400959.287209:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850174976 00000100:00100000:1.0:1786400959.287225:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850174976 00000100:00100000:1.0:1786400959.287364:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 68 00000100:00100000:1.0:1786400959.287378:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc6d7ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+20:12311:x1873176850174976:12345-192.168.204.8@tcp:35:umount.0 00000100:00100000:1.0:1786400959.288246:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc6d7ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:096c63d9-38b8-441b-8c71-343db25fe88a+21:12311:x1873176850174976:12345-192.168.204.8@tcp:35:umount.0 Request processed in 867us (1260us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1786400959.288257:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 68 00000100:00100000:0.0:1786400959.292212:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400959.292329:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850175232 00000100:00100000:3.0:1786400959.292342:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850175232 00000100:00100000:3.0:1786400959.292418:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 69 00000100:00100000:3.0:1786400959.292430:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d7000dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+21:12311:x1873176850175232:12345-192.168.204.8@tcp:35:umount.0 00000100:00100000:3.0:1786400959.293451:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d7000dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:096c63d9-38b8-441b-8c71-343db25fe88a+22:12311:x1873176850175232:12345-192.168.204.8@tcp:35:umount.0 Request processed in 1010us (1239us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1786400959.293674:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 69 00000100:00100000:0.0:1786400959.299672:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400959.299855:0:8369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850175360 00000100:00100000:1.0:1786400959.299868:0:8369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850175360 00000100:00100000:1.0:1786400959.300417:0:8369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 18 00000100:00100000:1.0:1786400959.300433:0:8369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d7000dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2363:x1873176850175360:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400959.300845:0:8369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400959.300877:0:8369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ffd5abc00/0x5ccaaf4f3cb1d909 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba70 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400959.300900:0:8369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400959.301680:0:8369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d7000dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6ee3c8da-45b0-4b79-a1d4-46386550e92b+12:2363:x1873176850175360:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 1246us (2016us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400959.301693:0:8369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 18 00000100:00100000:3.0:1786400959.303302:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400959.303343:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400959.303731:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850175488 00000100:00100000:1.0:1786400959.303746:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850175488 00000100:00100000:1.0:1786400959.303812:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850175616 00000100:00100000:1.0:1786400959.303815:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850175616 00000100:00100000:1.0:1786400959.303841:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 19 00000100:00100000:1.0:1786400959.303852:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd893b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+13:2363:x1873176850175488:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400959.303871:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786400959.303895:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fca090000/0x5ccaaf4f3cb1d86f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba38 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400959.303940:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400959.304565:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 20 00000100:00100000:2.0:1786400959.304583:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd890380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+12:2362:x1873176850175616:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786400959.304597:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400959.304625:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc4e5de00/0x5ccaaf4f3cb1db1d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb3b expref: 12 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400959.304636:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786400959.306134:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd893b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+11:2363:x1873176850175488:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 2269us (2830us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400959.306151:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 19 00000100:00100000:2.0:1786400959.306295:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd890380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:2362:x1873176850175616:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 1717us (2948us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400959.306304:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 20 00000100:00100000:3.0:1786400959.308761:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786400959.309650:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850176000 00000100:00100000:2.0:1786400959.309665:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850176000 00000100:00100000:2.0:1786400959.310237:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 73 00000100:00100000:2.0:1786400959.310253:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fcbb16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+7:2361:x1873176850176000:12345-192.168.204.8@tcp:9:umount.0 00000020:00000080:2.0:1786400959.310293:0:6593:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5ccaaf4f3cb1de49 00000020:00010000:2.0:1786400959.310303:0:6593:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9d6fc849d800: total 0 00000100:00080000:2.0:1786400959.310309:0:6593:0:(import.c:65:import_set_state_nolock()) ffff9d6ff6fcf800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1786400959.310359:0:6593:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1786400959.311014:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fcbb16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:096c63d9-38b8-441b-8c71-343db25fe88a+5:2361:x1873176850176000:12345-192.168.204.8@tcp:9:umount.0 Request processed in 763us (2263us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400959.311023:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 73 00000020:00010000:1.0:1786400959.313387:0:5777:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9d6fc849d800: total 0 00010000:00010000:1.0:1786400959.313621:0:5777:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9d6fc849d800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1786400959.313706:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1e1e5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd10 expref: 4 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400959.313765:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1a88f7b/0x5ccaaf4f3cb1e883 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bede expref: 3 pid: 6592 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400959.313785:0:5777:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9d6fc849d800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1786400959.313798:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400959.313800:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400959.313802:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1786400959.319369:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786400959.323888:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400959.324794:0:11770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850176128 00000100:00100000:3.0:1786400959.324810:0:11770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850176128 00000100:00100000:0.0:1786400959.325445:0:11770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 74 00000100:00100000:0.0:1786400959.325602:0:11770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d7000dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:096c63d9-38b8-441b-8c71-343db25fe88a+5:2361:x1873176850176128:12345-192.168.204.8@tcp:9:umount.0 00000020:00000080:0.0:1786400959.325725:0:11770:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5ccaaf4f3cb1dbe1 00000100:00080000:0.0:1786400959.325741:0:11770:0:(import.c:65:import_set_state_nolock()) ffff9d6fc3077800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1786400959.325799:0:11770:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1786400959.326188:0:11770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d7000dd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:096c63d9-38b8-441b-8c71-343db25fe88a+2:2361:x1873176850176128:12345-192.168.204.8@tcp:9:umount.0 Request processed in 591us (2315us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400959.326198:0:11770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 74 00010000:00010000:3.0:1786400959.326275:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1786400959.327596:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786400959.337971:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400959.338193:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850177152 00000100:00100000:0.0:1786400959.338219:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850177152 00000100:00100000:0.0:1786400959.338399:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 240 00000100:00100000:0.0:1786400959.338411:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+22:2361:x1873176850177152:12345-192.168.204.8@tcp:39:umount.0 00000020:00000080:0.0:1786400959.338777:0:5790:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5ccaaf4f3cb1d87d 00000020:00010000:0.0:1786400959.338803:0:5790:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9d6ff5fce800: total 0 00000100:00080000:0.0:1786400959.338809:0:5790:0:(import.c:65:import_set_state_nolock()) ffff9d6ff5fc8000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1786400959.338853:0:5790:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:0.0:1786400959.339426:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:096c63d9-38b8-441b-8c71-343db25fe88a+21:2361:x1873176850177152:12345-192.168.204.8@tcp:39:umount.0 Request processed in 1012us (1465us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1786400959.339439:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 240 00000020:00010000:1.0:1786400959.340680:0:5777:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9d6ff5fce800: total 0 00010000:00010000:1.0:1786400959.340695:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400959.340775:0:5777:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9d6ff5fce800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1786400959.340827:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d6fc5599c00) 00010000:00010000:1.0:1786400959.340832:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786400959.340845:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e400/0x5ccaaf4f3cb1e0c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcc3 expref: 20 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400959.340874:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d6fd022e000) 00010000:00010000:1.0:1786400959.340877:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1786400959.340900:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5dc00/0x5ccaaf4f3cb1dbb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb65 expref: 19 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400959.340916:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:1.0:1786400959.340918:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786400959.340922:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1e764 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be91 expref: 18 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400959.340935:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d6fc5599e00) 00010000:00010000:1.0:1786400959.340937:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1786400959.340941:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091200/0x5ccaaf4f3cb1e263 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd33 expref: 17 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400959.340954:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d6fc5599600) 00010000:00010000:1.0:1786400959.340957:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786400959.340961:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7d39200/0x5ccaaf4f3cb1db63 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb50 expref: 16 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400959.340982:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fc5599b00) 00010000:00010000:1.0:1786400959.340985:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786400959.340990:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091400/0x5ccaaf4f3cb1e247 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd2c expref: 15 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400959.341001:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:1.0:1786400959.341003:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1786400959.341007:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bb000/0x5ccaaf4f3cb1e86e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bed7 expref: 14 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400959.341018:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d6fc5599c00) 00010000:00010000:1.0:1786400959.341026:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786400959.341030:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138e800/0x5ccaaf4f3cb1e1a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bcfb expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400959.341044:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9d6fc5599c00) 00010000:00010000:1.0:1786400959.341046:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1786400959.341049:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091000/0x5ccaaf4f3cb1e1d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bd09 expref: 12 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400959.341063:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:1.0:1786400959.341066:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786400959.341069:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba200/0x5ccaaf4f3cb1e844 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bec9 expref: 11 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400959.341127:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9d6fd022e000) 00010000:00010000:1.0:1786400959.341130:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1786400959.341134:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1dea4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bc37 expref: 10 pid: 6615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400959.341153:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d6fe06cb400) 00010000:00010000:1.0:1786400959.341156:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1786400959.341159:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f000/0x5ccaaf4f3cb1db47 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb49 expref: 9 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400959.341173:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9d6fc5599e00) 00010000:00010000:1.0:1786400959.341175:0:5777:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1786400959.341179:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1ba000/0x5ccaaf4f3cb1e542 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6be05 expref: 8 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400959.341205:0:5777:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9d6ff5fce800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1786400959.341219:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400959.341221:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400959.341223:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400959.406868:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400960.238434:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd890700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872171264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786400960.238525:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400960.238771:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872171264 00000100:00100000:3.0:1786400960.238781:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872171264 00000100:00100000:3.0:1786400960.239525:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1786400960.239541:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872171264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786400960.239660:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786400960.239743:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872171264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 209us (1219us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400960.239750:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1786400960.240175:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd890700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872171264:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1786400960.240422:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1786400960.430383:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400960.560922:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400960.560985:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400960.561896:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850177408 00000100:00100000:0.0:1786400960.561908:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850177408 00000100:00100000:0.0:1786400960.561985:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 168 00000100:00100000:0.0:1786400960.561996:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+6:2365:x1873176850177408:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:1.0:1786400960.562702:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850177280 00000100:00100000:1.0:1786400960.562711:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850177280 00000100:00100000:1.0:1786400960.562756:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 300 00000100:00100000:1.0:1786400960.562764:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:2365:x1873176850177280:12345-192.168.204.8@tcp:400:kworker.0 00000100:00080000:2.0:1786400960.562828:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786400960.565322:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+6:2365:x1873176850177408:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 3316us (4398us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400960.565337:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 168 00000100:00100000:1.0:1786400960.565482:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:2365:x1873176850177280:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 2718us (4496us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400960.565492:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 300 00000100:00100000:3.0:1786400960.750369:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd891c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872171520:0@lo:400:kworker.0 00000100:00100000:3.0:1786400960.750446:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400960.750446:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1873176872171648:0@lo:400:kworker.0 00000100:00100000:0.0:1786400960.750486:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400960.750518:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd890e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872172032:0@lo:400:kworker.0 00000100:00100000:0.0:1786400960.750525:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d7000dd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872172160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786400960.750555:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786400960.750564:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400960.750600:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872171520 00000100:00100000:0.0:1786400960.750604:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872171648 00000100:00100000:3.0:1786400960.750608:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872171520 00000100:00100000:0.0:1786400960.750610:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872171648 00000100:00100000:1.0:1786400960.750675:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd891f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872171776:0@lo:400:kworker.0 00000100:00100000:1.0:1786400960.750717:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400960.750744:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1786400960.750751:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd891180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872171392:0@lo:400:kworker.0 00000100:00100000:1.0:1786400960.750780:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400960.750802:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd893800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873176872171904:0@lo:400:kworker.0 00000100:00100000:1.0:1786400960.750823:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400960.750847:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872171392 00000100:00100000:1.0:1786400960.750850:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872171392 00000100:00100000:1.0:1786400960.750888:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1786400960.750897:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+19:3308:x1873176872171392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400960.750941:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:97b0324f-e214-4822-8711-e150ddac2a7e+19:3308:x1873176872171392:12345-0@lo:400:kworker.0 Request processed in 45us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400960.750965:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1786400960.750999:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872171904 00000100:00100000:1.0:1786400960.751002:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872171904 00000100:00100000:0.0:1786400960.751141:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1786400960.751491:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872172032 00000100:00100000:2.0:1786400960.751495:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872172032 00000100:00100000:2.0:1786400960.751832:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872171776 00000100:00100000:2.0:1786400960.751836:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872171776 00000100:00100000:2.0:1786400960.752494:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1786400960.752504:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872172032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400960.752943:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1786400960.752952:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873176872171904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786400960.753009:0:5788:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1786400960.753019:0:5788:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1786400960.753179:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872172160 00000100:00100000:3.0:1786400960.753186:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872172160 00000100:00100000:3.0:1786400960.753218:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1786400960.753225:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1873176872172160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786400960.753254:0:6595:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786400960.753379:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d7000dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873176872171648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786400960.753399:0:11770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1786400960.753501:0:11770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6fe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872171776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400960.753899:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1873176872171904:12345-0@lo:400:kworker.0 Request processed in 945us (3072us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400960.753907:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1873176872172160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 679us (3341us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400960.753913:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1786400960.753920:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1786400960.753939:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1786400960.753949:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872171520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786400960.753986:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872171520:12345-0@lo:400:kworker.0 Request processed in 39us (3541us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400960.753993:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1786400960.754047:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd891180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872171392:0@lo:400:kworker.0 00000100:00100000:1.0:1786400960.754062:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd893800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1873176872171904:0@lo:400:kworker.0 00000100:00080000:1.0:1786400960.754128:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786400960.754134:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786400960.754156:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd891c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872171520:0@lo:400:kworker.0 00000100:00100000:3.0:1786400960.754171:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd890e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872172032:0@lo:400:kworker.0 00000100:00100000:1.0:1786400960.754178:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d7000dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1873176872171648:12345-0@lo:400:kworker.0 Request processed in 3029us (3690us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400960.754185:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1786400960.754220:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1873176872171648:0@lo:400:kworker.0 00000100:00100000:3.0:1786400960.754238:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d7000dd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872172160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786400960.754951:0:11770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6fe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872171776:12345-0@lo:400:kworker.0 Request processed in 1542us (4230us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400960.754960:0:11770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1786400960.755137:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd891f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872171776:0@lo:400:kworker.0 00000100:00100000:2.0:1786400960.755204:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872172032:12345-0@lo:400:kworker.0 Request processed in 2700us (4648us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400960.755213:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1786400960.955368:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400960.955936:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786400960.956277:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400960.956327:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850177664 00000100:00100000:1.0:1786400960.956341:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850177664 00000100:00100000:1.0:1786400960.956410:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850177536 00000100:00100000:1.0:1786400960.956414:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850177536 00000100:00100000:1.0:1786400960.956460:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 21 00000100:00100000:1.0:1786400960.956471:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd890000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+11:2363:x1873176850177664:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786400960.956495:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1786400960.956546:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 22 00000100:00100000:2.0:1786400960.956558:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd890e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+11:2363:x1873176850177536:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786400960.956566:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786400960.956596:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc4e5d800/0x5ccaaf4f3cb1d94f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba85 expref: 11 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400960.956619:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786400960.956698:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd890e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+10:2363:x1873176850177536:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 143us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1786400960.956706:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 22 00010000:00010000:1.0:1786400960.956889:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc4e5c200/0x5ccaaf4f3cb1d956 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6baaf expref: 9 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400960.956901:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400960.957077:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850177792 00000100:00100000:0.0:1786400960.957101:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850177792 00000100:00100000:1.0:1786400960.957185:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd890000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6ee3c8da-45b0-4b79-a1d4-46386550e92b+9:2363:x1873176850177664:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 715us (1831us total) trans 0 rc 0/0 00000100:00100000:0.0:1786400960.957281:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 23 00000100:00100000:0.0:1786400960.957293:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd891c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+9:2363:x1873176850177792:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786400960.957304:0:5773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786400960.957327:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe7d39800/0x5ccaaf4f3cb1db16 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bb34 expref: 9 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400960.957479:0:5773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786400960.957511:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd891c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+8:2363:x1873176850177792:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 220us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400960.957534:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 21 00000100:00100000:0.0:1786400960.957622:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 23 00000100:00100000:3.0:1786400960.965195:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786400960.965286:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850178048 00000100:00100000:0.0:1786400960.965307:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850178048 00000100:00100000:2.0:1786400960.965455:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 241 00000100:00100000:2.0:1786400960.965473:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+6:2361:x1873176850178048:12345-192.168.204.8@tcp:39:umount.0 00000020:00000080:2.0:1786400960.965545:0:6615:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5ccaaf4f3cb1d964 00000020:00010000:2.0:1786400960.965556:0:6615:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9d6ff5fcc000: total 0 00000100:00080000:2.0:1786400960.965561:0:6615:0:(import.c:65:import_set_state_nolock()) ffff9d6ff5fcd800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1786400960.965618:0:6615:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:2.0:1786400960.965938:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa744aa8-4d1c-4b23-b1b9-d5765b6f6856+5:2361:x1873176850178048:12345-192.168.204.8@tcp:39:umount.0 Request processed in 470us (758us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1786400960.965948:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 241 00000020:00010000:3.0:1786400960.967259:0:5776:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9d6ff5fcc000: total 0 00010000:00010000:3.0:1786400960.967343:0:5776:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9d6ff5fcc000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1786400960.967394:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fc5599b00) 00010000:00010000:3.0:1786400960.967398:0:5776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1786400960.967410:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1e891 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bee5 expref: 4 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400960.967441:0:5776:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9d6ff5fcc000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1786400960.967454:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400960.967457:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400960.967458:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400960.983323:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786400960.983619:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850178304 00000100:00100000:1.0:1786400960.983634:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850178304 00000100:00100000:1.0:1786400960.983833:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 302 00000100:00100000:1.0:1786400960.983846:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3e66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+7:2361:x1873176850178304:12345-192.168.204.8@tcp:251:umount.0 00000020:00000080:1.0:1786400960.983916:0:5780:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5ccaaf4f3cb1d85a 00000020:00010000:1.0:1786400960.983926:0:5780:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9d6fc3299000: total 0 00000100:00080000:1.0:1786400960.983931:0:5780:0:(import.c:65:import_set_state_nolock()) ffff9d6fc329a000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1786400960.984029:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3e66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6ee3c8da-45b0-4b79-a1d4-46386550e92b+3:2361:x1873176850178304:12345-192.168.204.8@tcp:251:umount.0 Request processed in 185us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400960.984038:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 302 00000020:00010000:0.0:1786400960.984143:0:5777:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9d6fc3299000: total 0 00010000:00010000:0.0:1786400960.984148:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400960.984198:0:5777:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9d6fc3299000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1786400960.984240:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ffd5abe00/0x5ccaaf4f3cb1d910 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6ba77 expref: 2 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400960.984264:0:5777:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9d6fc3299000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1786400960.984273:0:5777:0:(genops.c:906:class_export_put()) final put ffff9d6fc3299000/6ee3c8da-45b0-4b79-a1d4-46386550e92b 00010000:00010000:0.0:1786400960.984289:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400960.984291:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400960.984292:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1786400960.984304:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc3299000/6ee3c8da-45b0-4b79-a1d4-46386550e92b for MGS 00000020:00000080:0.0:1786400960.984339:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6fc329a000 for MGS 00000040:00080000:1.0:1786400961.006606:0:11546:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1786400961.006620:0:11546:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786400961.007820:0:11546:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1786400961.007833:0:11546:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1786400961.455574:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1786400962.329925:0:6619:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 096c63d9-38b8-441b-8c71-343db25fe88a 00000020:00000080:0.0:1786400962.329940:0:6619:0:(genops.c:906:class_export_put()) final put ffff9d6fc3074000/096c63d9-38b8-441b-8c71-343db25fe88a 00000020:00000080:3.0:1786400962.330317:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc3074000/096c63d9-38b8-441b-8c71-343db25fe88a for lustre-OST0000 00000020:00000080:3.0:1786400962.330760:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6fc3077800 for lustre-OST0000 00010000:00010000:0.0:1786400962.490178:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1786400962.987713:0:12882:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1786400963.025213:0:12882:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1786400963.025265:0:12882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5d200/0x5ccaaf4f3cb1d8df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d8e6 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400963.025299:0:12882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5d200/0x5ccaaf4f3cb1d8df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d8e6 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400963.025306:0:12882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5d200/0x5ccaaf4f3cb1d8df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5ccaaf4f3cb1d8e6 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400963.025313:0:12882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5d200/0x5ccaaf4f3cb1d8df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5ccaaf4f3cb1d8e6 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400963.025327:0:12882:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1786400963.025332:0:12882:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1786400963.025367:0:12882:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1786400963.025372:0:12882:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1786400963.025378:0:12882:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1786400963.025403:0:12882:0:(import.c:65:import_set_state_nolock()) ffff9d6ffe12e800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1786400963.025599:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873176872172288:0@lo:39:umount.0 00000100:00100000:2.0:1786400963.025678:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400963.026265:0:12795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872172288 00000100:00100000:1.0:1786400963.026274:0:12795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872172288 00000100:00100000:1.0:1786400963.026317:0:12795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1786400963.026326:0:12795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1873176872172288:12345-0@lo:39:umount.0 00000020:00000080:1.0:1786400963.026352:0:12795:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5ccaaf4f3cb1d677 00000100:00080000:1.0:1786400963.026706:0:12795:0:(import.c:65:import_set_state_nolock()) ffff9d6fff883800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1786400963.026778:0:12795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3305:x1873176872172288:12345-0@lo:39:umount.0 Request processed in 452us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400963.026786:0:12795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1786400963.026795:0:12795:0:(genops.c:906:class_export_put()) final put ffff9d6feddc7800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1786400963.027132:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786400963.027140:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5d200/0x5ccaaf4f3cb1d8df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5ccaaf4f3cb1d8e6 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400963.027151:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5d200 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:2.0:1786400963.027155:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5d200/0x5ccaaf4f3cb1d8df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5ccaaf4f3cb1d8e6 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400963.027176:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5d200/0x5ccaaf4f3cb1d8df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x5ccaaf4f3cb1d8e6 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786400963.027184:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5d200/0x5ccaaf4f3cb1d8df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x5ccaaf4f3cb1d8e6 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786400963.027190:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1786400963.027193:0:5777:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1786400963.027196:0:5777:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1786400963.027223:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5d200/0x5ccaaf4f3cb1d8df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5ccaaf4f3cb1d8e6 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400963.027230:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786400963.027252:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5d200/0x5ccaaf4f3cb1d8df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5ccaaf4f3cb1d8e6 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400963.027275:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5d200/0x5ccaaf4f3cb1d8df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5ccaaf4f3cb1d8e6 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400963.027288:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400963.027290:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786400963.027292:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400963.027300:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1786400963.027312:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:97b0324f-e214-4822-8711-e150ddac2a7e:3309:1873176872172416:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786400963.027352:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1786400963.027423:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9d6ffe12e800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1786400963.027432:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873176872172288:0@lo:39:umount.0 00000100:00080000:1.0:1786400963.028242:0:12882:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1786400963.028247:0:12882:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1786400963.028263:0:12882:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1786400963.028515:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1786400963.028528:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6feddc7800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1786400963.028583:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6fff883800 for lustre-MDT0000 00000100:00100000:3.0:1786400963.028620:0:8369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872172416 00000100:00100000:3.0:1786400963.028630:0:8369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872172416 00000100:00100000:3.0:1786400963.028693:0:8369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1786400963.028702:0:8369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc35dc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:97b0324f-e214-4822-8711-e150ddac2a7e+19:3309:x1873176872172416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786400963.028714:0:8369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400963.028730:0:8369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d70020e5200/0x5ccaaf4f3cb1d8e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d8df expref: 19 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400963.028745:0:8369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400963.028791:0:8369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc35dc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:97b0324f-e214-4822-8711-e150ddac2a7e+18:3309:x1873176872172416:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (1439us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400963.028809:0:8369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1786400963.031916:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:97b0324f-e214-4822-8711-e150ddac2a7e:3309:1873176872172416:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786400963.034603:0:12882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab000/0x5ccaaf4f3cb1d8ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d8f4 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400963.034622:0:12882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab000/0x5ccaaf4f3cb1d8ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d8f4 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400963.034629:0:12882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab000/0x5ccaaf4f3cb1d8ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5ccaaf4f3cb1d8f4 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400963.034636:0:12882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab000/0x5ccaaf4f3cb1d8ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5ccaaf4f3cb1d8f4 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400963.034675:0:12882:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786400963.034682:0:12882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc0030e00/0x5ccaaf4f3cb1d814 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d81b expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400963.034688:0:12882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc0030e00/0x5ccaaf4f3cb1d814 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d81b expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400963.034694:0:12882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc0030e00/0x5ccaaf4f3cb1d814 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5ccaaf4f3cb1d81b expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400963.034699:0:12882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.108@tcp lock: ffff9d6fc0030e00/0x5ccaaf4f3cb1d814 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5ccaaf4f3cb1d81b expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400963.034710:0:12882:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1786400963.034718:0:12882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38600/0x5ccaaf4f3cb1db08 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1db0f expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400963.034724:0:12882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38600/0x5ccaaf4f3cb1db08 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1db0f expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400963.034746:0:12882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38600/0x5ccaaf4f3cb1db08 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5ccaaf4f3cb1db0f expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400963.034752:0:12882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38600/0x5ccaaf4f3cb1db08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5ccaaf4f3cb1db0f expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400963.034759:0:12882:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1786400963.034765:0:12882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38800/0x5ccaaf4f3cb1d5c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d5cf expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400963.034770:0:12882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38800/0x5ccaaf4f3cb1d5c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d5cf expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400963.034776:0:12882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38800/0x5ccaaf4f3cb1d5c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5ccaaf4f3cb1d5cf expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400963.034782:0:12882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38800/0x5ccaaf4f3cb1d5c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5ccaaf4f3cb1d5cf expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400963.034788:0:12882:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1786400963.034791:0:12882:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1786400963.034818:0:12882:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1786400963.034822:0:12882:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1786400963.034826:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1786400963.034831:0:12882:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:1.0:1786400963.034839:0:12882:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9d6fc3377000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1786400963.034844:0:12882:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9d6ec507b000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1786400963.034852:0:12882:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9d6ff5fcc000 fa744aa8-4d1c-4b23-b1b9-d5765b6f6856 192.168.204.8@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1786400963.034862:0:12882:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9d6ff5fce800 096c63d9-38b8-441b-8c71-343db25fe88a 192.168.204.8@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967520 stale:0 00000020:00080000:1.0:1786400963.034867:0:12882:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9d6fc97bcd40) has exports, disconnecting them 00000020:00080000:1.0:1786400963.034871:0:12882:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9d6fc3377000), last request at 1786400960 00000020:00000080:1.0:1786400963.034878:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5ccaaf4f3cb1d7dc 00000100:00080000:1.0:1786400963.034893:0:12882:0:(import.c:65:import_set_state_nolock()) ffff9d6ec4d85000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1786400963.034928:0:12882:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d6fc3377000): rc 0 00000020:00000080:1.0:1786400963.034930:0:12882:0:(genops.c:906:class_export_put()) final put ffff9d6fc3377000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1786400963.034936:0:12882:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9d6ec507b000), last request at 1786400960 00000020:00000080:1.0:1786400963.034940:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5ccaaf4f3cb1d711 00000100:00080000:1.0:1786400963.034944:0:12882:0:(import.c:65:import_set_state_nolock()) ffff9d6ec507a800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1786400963.034951:0:12882:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d6ec507b000): rc 0 00000020:00000080:1.0:1786400963.034953:0:12882:0:(genops.c:906:class_export_put()) final put ffff9d6ec507b000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1786400963.034960:0:12882:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbdcdc1c53ae0 00000100:00080000:1.0:1786400963.034979:0:12882:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1786400963.034982:0:12882:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1786400963.034993:0:12882:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1786400963.035055:0:12882:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1786400963.035075:0:12882:0:(import.c:65:import_set_state_nolock()) ffff9d6fc849d000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1786400963.035108:0:12882:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1786400963.035111:0:12882:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:1.0:1786400963.035121:0:12882:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:3.0:1786400963.035407:0:12743:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc3377000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1786400963.035442:0:12743:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec507b000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1786400963.035466:0:12743:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ec4d85000 for lustre-MDT0000 00000020:00000080:3.0:1786400963.035471:0:12743:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ec507a800 for lustre-MDT0000 00010000:00010000:3.0:1786400963.035481:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1786400963.035487:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab000/0x5ccaaf4f3cb1d8ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5ccaaf4f3cb1d8f4 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400963.035494:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5ab000 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:3.0:1786400963.035497:0:5776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab000/0x5ccaaf4f3cb1d8ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5ccaaf4f3cb1d8f4 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400963.035506:0:5776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab000/0x5ccaaf4f3cb1d8ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x5ccaaf4f3cb1d8f4 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786400963.035513:0:5776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab000/0x5ccaaf4f3cb1d8ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x5ccaaf4f3cb1d8f4 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400963.035519:0:5776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1786400963.035522:0:5776:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1786400963.035526:0:5776:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1786400963.035549:0:5776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab000/0x5ccaaf4f3cb1d8ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5ccaaf4f3cb1d8f4 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400963.035555:0:5776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786400963.035575:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab000/0x5ccaaf4f3cb1d8ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5ccaaf4f3cb1d8f4 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400963.035581:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab000/0x5ccaaf4f3cb1d8ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5ccaaf4f3cb1d8f4 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400963.035600:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1786400963.035604:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fc0030e00/0x5ccaaf4f3cb1d814 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5ccaaf4f3cb1d81b expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400963.035609:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc0030e00 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:3.0:1786400963.035612:0:5776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc0030e00/0x5ccaaf4f3cb1d814 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5ccaaf4f3cb1d81b expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400963.035619:0:5776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fc0030e00/0x5ccaaf4f3cb1d814 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5ccaaf4f3cb1d81b expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786400963.035624:0:5776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc0030e00/0x5ccaaf4f3cb1d814 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5ccaaf4f3cb1d81b expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400963.035629:0:5776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1786400963.035631:0:5776:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1786400963.035633:0:5776:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1786400963.035660:0:5776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6fc0030e00/0x5ccaaf4f3cb1d814 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5ccaaf4f3cb1d81b expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400963.035666:0:5776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786400963.035681:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fc0030e00/0x5ccaaf4f3cb1d814 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5ccaaf4f3cb1d81b expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400963.035688:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fc0030e00/0x5ccaaf4f3cb1d814 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5ccaaf4f3cb1d81b expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400963.035701:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786400963.035704:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38600/0x5ccaaf4f3cb1db08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5ccaaf4f3cb1db0f expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400963.035716:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7d38600 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:3.0:1786400963.035719:0:5776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38600/0x5ccaaf4f3cb1db08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5ccaaf4f3cb1db0f expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400963.035726:0:5776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38600/0x5ccaaf4f3cb1db08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5ccaaf4f3cb1db0f expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786400963.035732:0:5776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38600/0x5ccaaf4f3cb1db08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5ccaaf4f3cb1db0f expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400963.035737:0:5776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1786400963.035739:0:5776:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1786400963.035741:0:5776:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1786400963.035754:0:5776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38600/0x5ccaaf4f3cb1db08 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5ccaaf4f3cb1db0f expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400963.035760:0:5776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786400963.035766:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38600/0x5ccaaf4f3cb1db08 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5ccaaf4f3cb1db0f expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400963.035773:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38600/0x5ccaaf4f3cb1db08 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5ccaaf4f3cb1db0f expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400963.035781:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786400963.035784:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38800/0x5ccaaf4f3cb1d5c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5ccaaf4f3cb1d5cf expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400963.035790:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7d38800 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:3.0:1786400963.035793:0:5776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38800/0x5ccaaf4f3cb1d5c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5ccaaf4f3cb1d5cf expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400963.035805:0:5776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38800/0x5ccaaf4f3cb1d5c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5ccaaf4f3cb1d5cf expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786400963.035812:0:5776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38800/0x5ccaaf4f3cb1d5c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5ccaaf4f3cb1d5cf expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400963.035817:0:5776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1786400963.035819:0:5776:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1786400963.035821:0:5776:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1786400963.035831:0:5776:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38800/0x5ccaaf4f3cb1d5c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5ccaaf4f3cb1d5cf expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400963.035836:0:5776:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786400963.035841:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38800/0x5ccaaf4f3cb1d5c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5ccaaf4f3cb1d5cf expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400963.035847:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d38800/0x5ccaaf4f3cb1d5c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5ccaaf4f3cb1d5cf expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400963.035857:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400963.035859:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400963.035861:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400963.035874:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872173056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786400963.035936:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400963.035979:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786400963.035985:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd893b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872172672:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786400963.036004:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400963.036026:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd890380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:97b0324f-e214-4822-8711-e150ddac2a7e:3306:1873176872172800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786400963.036054:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400963.036068:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1786400963.036072:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd890e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:97b0324f-e214-4822-8711-e150ddac2a7e:3306:1873176872172928:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786400963.036105:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400963.036311:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872173056 00000100:00100000:3.0:1786400963.036318:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872173056 00000100:00100000:3.0:1786400963.036353:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872172672 00000100:00100000:3.0:1786400963.036355:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872172672 00000100:00100000:3.0:1786400963.036365:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872172800 00000100:00100000:3.0:1786400963.036367:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872172800 00000100:00100000:3.0:1786400963.036376:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872172928 00000100:00100000:3.0:1786400963.036378:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872172928 00000100:00100000:3.0:1786400963.036391:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1786400963.036399:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd891c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:97b0324f-e214-4822-8711-e150ddac2a7e+21:3308:x1873176872173056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786400963.036411:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400963.036424:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fca090800/0x5ccaaf4f3cb1d5cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d5c8 expref: 21 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400963.036438:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400963.036469:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd891c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:97b0324f-e214-4822-8711-e150ddac2a7e+20:3308:x1873176872173056:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400963.036476:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1786400963.036489:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1786400963.036495:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd893800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:97b0324f-e214-4822-8711-e150ddac2a7e+19:3308:x1873176872172672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786400963.036502:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400963.036509:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc4e5c400/0x5ccaaf4f3cb1d8f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d8ed expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400963.036517:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400963.036540:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd893800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:97b0324f-e214-4822-8711-e150ddac2a7e+18:3308:x1873176872172672:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400963.036545:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1786400963.036555:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1786400963.036560:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd891180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:97b0324f-e214-4822-8711-e150ddac2a7e+17:3306:x1873176872172800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786400963.036566:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400963.036573:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc0031600/0x5ccaaf4f3cb1d81b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d814 expref: 17 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400963.036586:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400963.036606:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd891180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:97b0324f-e214-4822-8711-e150ddac2a7e+16:3306:x1873176872172800:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400963.036612:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1786400963.036623:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1786400963.036629:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d7000dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:97b0324f-e214-4822-8711-e150ddac2a7e+15:3306:x1873176872172928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786400963.036636:0:5774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786400963.036815:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc4e5ce00/0x5ccaaf4f3cb1db0f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1db08 expref: 15 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400963.036826:0:5774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786400963.036849:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d7000dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:97b0324f-e214-4822-8711-e150ddac2a7e+14:3306:x1873176872172928:12345-0@lo:103:ldlm_bl.0 Request processed in 221us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400963.036855:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1786400963.036895:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd890e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:97b0324f-e214-4822-8711-e150ddac2a7e:3306:1873176872172928:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786400963.036905:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd890380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:97b0324f-e214-4822-8711-e150ddac2a7e:3306:1873176872172800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786400963.036928:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd893b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872172672:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786400963.036944:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872173056:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786400963.036990:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786400963.036999:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873176872172544:0@lo:9:umount.0 00000100:00100000:3.0:1786400963.037025:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786400963.037057:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872172544 00000100:00100000:3.0:1786400963.037061:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872172544 00000100:00080000:1.0:1786400963.037370:0:12882:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1786400963.037387:0:12882:0:(import.c:65:import_set_state_nolock()) ffff9d6fc4811000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1786400963.037429:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9d6fc97bcd40) has no exports 00000100:00100000:3.0:1786400963.038104:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1786400963.038211:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d7000dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1873176872172544:12345-0@lo:9:umount.0 00000020:00000080:3.0:1786400963.038235:0:6590:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5ccaaf4f3cb1d75e 00000100:00080000:3.0:1786400963.038243:0:6590:0:(import.c:65:import_set_state_nolock()) ffff9d6ec507b800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1786400963.038273:0:6590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1786400963.038572:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d7000dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3305:x1873176872172544:12345-0@lo:9:umount.0 Request processed in 459us (1544us total) trans 0 rc 0/0 00000100:00100000:3.0:1786400963.038579:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:2.0:1786400963.038748:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1786400963.039448:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786400963.039468:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873176872173184:0@lo:9:umount.0 00000100:00100000:3.0:1786400963.039509:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1786400963.039585:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9d6fc849d000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1786400963.039602:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1786400963.039604:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1786400963.039607:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873176872172544:0@lo:9:umount.0 00000100:00100000:1.0:1786400963.039700:0:11770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872173184 00000100:00100000:1.0:1786400963.039706:0:11770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872173184 00000100:00100000:1.0:1786400963.039779:0:11770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1786400963.039787:0:11770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd890000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1873176872173184:12345-0@lo:9:umount.0 00000020:00000080:1.0:1786400963.039814:0:11770:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5ccaaf4f3cb1d845 00000100:00080000:1.0:1786400963.039821:0:11770:0:(import.c:65:import_set_state_nolock()) ffff9d6ec4708000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1786400963.039860:0:11770:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1786400963.039993:0:11770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd890000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3305:x1873176872173184:12345-0@lo:9:umount.0 Request processed in 205us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1786400963.040000:0:11770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:2.0:1786400963.040122:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1786400963.040389:0:5784:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786400963.040411:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9d6fc4811000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1786400963.040452:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1786400963.040559:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1786400963.040563:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873176872173184:0@lo:9:umount.0 00000020:00080000:1.0:1786400963.045412:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9d6fc97bcd40) has no exports 00000020:00000080:1.0:1786400963.112053:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5ccaaf4f3cb1d623 00000020:00000080:1.0:1786400963.112069:0:12882:0:(genops.c:906:class_export_put()) final put ffff9d6fee3a4800/lustre-QMT0000_UUID 00000020:01000000:1.0:1786400963.112130:0:12882:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1786400963.112146:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fee3a4800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1786400963.114489:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786400963.114504:0:12882:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1786400963.114510:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9d6fc52399c0) has no exports 00000020:00000080:0.0:1786400963.115479:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5ccaaf4f3cb1d61c 00000020:00000080:0.0:1786400963.115489:0:12882:0:(genops.c:906:class_export_put()) final put ffff9d6fff885000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1786400963.115555:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786400963.115563:0:12882:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1786400963.115566:0:12882:0:(genops.c:906:class_export_put()) final put ffff9d6fff886800/lustre-QMT0000_UUID 00000020:00000080:0.0:1786400963.115569:0:12882:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fff886800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1786400963.115582:0:12882:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1786400963.117273:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fff885000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1786400963.502714:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1786400963.885769:0:7501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1786400963.885779:0:7501:0:(genops.c:906:class_export_put()) final put ffff9d6ec470f000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1786400963.885803:0:7501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 096c63d9-38b8-441b-8c71-343db25fe88a 00000020:00000080:2.0:1786400963.885805:0:7501:0:(genops.c:906:class_export_put()) final put ffff9d6fc849d800/096c63d9-38b8-441b-8c71-343db25fe88a 00000020:00000080:2.0:1786400963.885818:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec470f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1786400963.885883:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc849d800/096c63d9-38b8-441b-8c71-343db25fe88a for lustre-OST0001 00000020:00000080:2.0:1786400963.885905:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ec4708000 for lustre-OST0001 00000020:00000080:2.0:1786400963.885909:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ff6fcf800 for lustre-OST0001 00000001:00100000:1.0:1786400963.897004:0:5810:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 096c63d9-38b8-441b-8c71-343db25fe88a 00000001:00080000:1.0:1786400963.897024:0:5810:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:1.0:1786400963.897052:0:5810:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fa744aa8-4d1c-4b23-b1b9-d5765b6f6856 00000001:00080000:1.0:1786400963.897058:0:5810:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1786400963.897062:0:5810:0:(genops.c:906:class_export_put()) final put ffff9d6ff5fcc000/fa744aa8-4d1c-4b23-b1b9-d5765b6f6856 00000020:00000080:1.0:1786400963.897116:0:5810:0:(genops.c:906:class_export_put()) final put ffff9d6ff5fce800/096c63d9-38b8-441b-8c71-343db25fe88a 00000020:00000080:2.0:1786400963.897229:0:12743:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ff5fcc000/fa744aa8-4d1c-4b23-b1b9-d5765b6f6856 for lustre-MDT0000 00000020:00000080:2.0:1786400963.897278:0:12743:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ff5fce800/096c63d9-38b8-441b-8c71-343db25fe88a for lustre-MDT0000 00000020:00000080:2.0:1786400963.897323:0:12743:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ff5fcd800 for lustre-MDT0000 00000020:00000080:2.0:1786400963.897342:0:12743:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ff5fc8000 for lustre-MDT0000 00010000:00010000:2.0:1786400964.526327:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1786400965.166290:0:12882:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9d6fc95c8a20 - data ffff9d7000be96c0/ffff9d6ffdea7000 00000020:01000000:0.0:1786400965.166425:0:12882:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9d6fc4ab2f60 - data ffff9d7000845af8/ffff9d6fc3312800 00000001:00000004:0.0:1786400965.173412:0:12882:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:3.0:1786400965.267846:0:12882:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1786400965.267854:0:12882:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1786400965.267886:0:12882:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1786400965.267889:0:12882:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1786400965.268723:0:6978:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1786400965.268728:0:6978:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1786400965.268742:0:6978:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1786400965.271064:0:12882:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1786400965.271072:0:12882:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1786400965.271117:0:12882:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1786400965.271121:0:12882:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1786400965.271439:0:7756:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1786400965.271444:0:7756:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1786400965.271454:0:7756:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1786400965.379981:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5ccaaf4f3cb1d5eb 00000020:00000080:1.0:1786400965.379996:0:12882:0:(genops.c:906:class_export_put()) final put ffff9d6ffe12f800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1786400965.380582:0:12743:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ffe12f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1786400965.387231:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5ccaaf4f3cb1d600 00000020:00000080:0.0:1786400965.387248:0:12882:0:(genops.c:906:class_export_put()) final put ffff9d6ffe128800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1786400965.387634:0:12882:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1786400965.387645:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786400965.387655:0:12882:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1786400965.387659:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9d6fc97b8000) has no exports 00000004:01000000:0.0:1786400965.388104:0:12882:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1786400965.388114:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5ccaaf4f3cb1d83e 00000020:00000080:0.0:1786400965.388120:0:12882:0:(genops.c:906:class_export_put()) final put ffff9d6fc4815800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1786400965.388946:0:12882:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1786400965.389006:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786400965.389016:0:12882:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1786400965.389021:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9d6fc33f19c0) has no exports 00000020:00000080:0.0:1786400965.389028:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5ccaaf4f3cb1d837 00000020:00000080:0.0:1786400965.389033:0:12882:0:(genops.c:906:class_export_put()) final put ffff9d6fc4811800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1786400965.389942:0:12743:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ffe128800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1786400965.389954:0:12743:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc4815800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1786400965.389958:0:12743:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc4811800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1786400965.390438:0:12882:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1786400965.390444:0:12882:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1786400965.390448:0:12882:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:0.0:1786400965.390454:0:12882:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1786400965.390456:0:12882:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1786400965.390502:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786400965.390511:0:12882:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1786400965.390522:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5ccaaf4f3cb1d757 00000020:00000080:0.0:1786400965.390529:0:12882:0:(genops.c:906:class_export_put()) final put ffff9d6fc8499800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1786400965.390533:0:12882:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1786400965.390538:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786400965.390542:0:12882:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1786400965.390545:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9d6fc33f4d40) has no exports 00000020:00000080:0.0:1786400965.390550:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5ccaaf4f3cb1d750 00000020:00000080:0.0:1786400965.390552:0:12882:0:(genops.c:906:class_export_put()) final put ffff9d6fc849e000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1786400965.391948:0:12743:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6fc4811000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1786400965.391961:0:12743:0:(genops.c:906:class_export_put()) final put ffff9d6fc340f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1786400965.391963:0:12743:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc340f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1786400965.391970:0:12743:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1786400965.392050:0:12743:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc8499800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1786400965.392055:0:12743:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc849e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1786400965.393233:0:12882:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1786400965.393239:0:12882:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1786400965.393254:0:12882:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1786400965.393261:0:12882:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1786400965.393264:0:12882:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1786400965.393637:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786400965.393651:0:12882:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1786400965.393700:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786400965.393704:0:12882:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1786400965.393708:0:12882:0:(genops.c:906:class_export_put()) final put ffff9d6fc28ea000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1786400965.393712:0:12882:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc28ea000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1786400965.393720:0:12882:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1786400965.394309:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5ccaaf4f3cb1d607 00000020:00000080:0.0:1786400965.394329:0:12882:0:(genops.c:906:class_export_put()) final put ffff9d6ffe128000/lustre-MDD0000_UUID 00000020:00000080:3.0:1786400965.395334:0:12743:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6fc849d000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1786400965.395347:0:12743:0:(genops.c:906:class_export_put()) final put ffff9d6ec470e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1786400965.395350:0:12743:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec470e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1786400965.395357:0:12743:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1786400965.395652:0:12882:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1786400965.395659:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786400965.395666:0:12882:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1786400965.395670:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9d6fc97bb380) has no exports 00000020:00000080:0.0:1786400965.395696:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786400965.395702:0:12882:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1786400965.395707:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5ccaaf4f3cb1d60e 00000020:00000080:0.0:1786400965.395713:0:12882:0:(genops.c:906:class_export_put()) final put ffff9d6ffe12b800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1786400965.395721:0:12882:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d6fc307d800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1786400965.395725:0:12882:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d6fc307d800 3 00000020:01000004:0.0:1786400965.395727:0:12882:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d6fc307d800 from lustre-MDT0000 00000020:00000080:0.0:1786400965.396414:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786400965.396420:0:12882:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1786400965.396424:0:12882:0:(genops.c:906:class_export_put()) final put ffff9d6ffe12d000/lustre-MDT0000_UUID 00000020:00000080:0.0:1786400965.396427:0:12882:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ffe12d000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1786400965.396435:0:12882:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1786400965.396485:0:12882:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1786400965.396489:0:12882:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1786400965.396492:0:12882:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1786400965.396495:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786400965.396509:0:12882:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1786400965.396516:0:12882:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9d6fc5245000 97b0324f-e214-4822-8711-e150ddac2a7e 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1786400965.396521:0:12882:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9d6fc65519c0) has exports, disconnecting them 00000020:00080000:0.0:1786400965.396525:0:12882:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9d6fc5245000), last request at 1786400741 00000020:00000080:0.0:1786400965.396539:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5ccaaf4f3cb1d5ac 00000020:00010000:0.0:1786400965.396543:0:12882:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9d6fc5245000: total 2 00000100:00080000:0.0:1786400965.396547:0:12882:0:(import.c:65:import_set_state_nolock()) ffff9d6fc5247800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1786400965.396574:0:12882:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d6fc5245000): rc 0 00000020:00080000:0.0:1786400965.396579:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9d6fc65519c0) has no exports 00000100:00100000:0.0:1786400965.396838:0:5783:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9d6fc6790200:5783] 2 exiting: rc = 0 00000020:00000080:3.0:1786400965.397070:0:12743:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ffe128000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1786400965.397076:0:12743:0:(genops.c:906:class_export_put()) final put ffff9d6ffe12c000/lustre-MDD0000_UUID 00000020:00000080:3.0:1786400965.397078:0:12743:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ffe12c000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1786400965.397083:0:12743:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1786400965.397295:0:12743:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ffe12b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:2.0:1786400965.397394:0:5781:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9d6fcb3c7600:5781] 1 exiting: rc = 0 00000020:00010000:1.0:1786400965.401459:0:5776:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9d6fc5245000: total 0 00010000:00010000:1.0:1786400965.401522:0:5776:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9d6fc5245000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1786400965.401556:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d70020e5600/0x5ccaaf4f3cb1d8bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d8b5 expref: 9 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400965.401578:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d70020e4400/0x5ccaaf4f3cb1d8ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d8a7 expref: 8 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400965.401620:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc4e5ca00/0x5ccaaf4f3cb1d8ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d8c3 expref: 7 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400965.401630:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d70020e5800/0x5ccaaf4f3cb1d8d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d8d1 expref: 6 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400965.401642:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc138f600/0x5ccaaf4f3cb1daf3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1daec expref: 5 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400965.401653:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe7d38200/0x5ccaaf4f3cb1db01 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1dafa expref: 4 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400965.401667:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fca090600/0x5ccaaf4f3cb1d6c4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d6bd expref: 3 pid: 5781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400965.401677:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ffd5aa000/0x5ccaaf4f3cb1d902 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1d8fb expref: 2 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400965.401688:0:5776:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9d6fc5245000, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1786400965.401702:0:5776:0:(genops.c:906:class_export_put()) final put ffff9d6fc5245000/97b0324f-e214-4822-8711-e150ddac2a7e 00010000:00010000:1.0:1786400965.401724:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400965.401726:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400965.401728:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786400965.403043:0:5780:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9d6fc4e5e200:5780] 0 exiting: rc = 1 00000020:00000080:1.0:1786400965.403157:0:12743:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc5245000/97b0324f-e214-4822-8711-e150ddac2a7e for MGS 00000020:00000080:1.0:1786400965.403189:0:12743:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6fc5247800 for MGS 00000100:00100000:3.0:1786400965.403943:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.403951:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.403956:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.403963:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.403970:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.403978:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.403984:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.403989:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.403996:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404002:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404009:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404015:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404020:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404025:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404031:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404036:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404041:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404047:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404053:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404059:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404064:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404068:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404074:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404080:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404111:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404117:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404122:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404128:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404134:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404139:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404144:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404149:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404154:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404158:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404163:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404184:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404189:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404193:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404199:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404204:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404209:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404215:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404220:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404226:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404231:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404236:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404242:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404247:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404252:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404258:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404263:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404269:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404274:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404280:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404285:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404291:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404296:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404301:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.404307:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.405545:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.405563:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.405575:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.405587:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.405729:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1786400965.407691:0:12882:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1786400965.407698:0:12882:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1786400965.412996:0:12882:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9d6ffd5196c0 - data ffff9d700082e6c0/ffff9d6fee1d4c00 00000020:01000000:3.0:1786400965.413187:0:12882:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9d6fc482e9c0 - data ffff9d700080eaf8/ffff9d6fc9257000 00000020:00000080:0.0:1786400965.418529:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5ccaaf4f3cb1d590 00000020:00000080:0.0:1786400965.418540:0:12882:0:(genops.c:906:class_export_put()) final put ffff9d6fcb3ec000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1786400965.419225:0:12882:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d6fc307d800 from MGS, refs=2 00000020:01000004:0.0:1786400965.419231:0:12882:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d6fc307d800 2 00000020:01000004:0.0:1786400965.419235:0:12882:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d6fc307d800 from MGS 00000020:00000080:0.0:1786400965.419274:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786400965.419284:0:12882:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1786400965.419286:0:12882:0:(genops.c:906:class_export_put()) final put ffff9d6fc307b800/MGS 00000020:00000080:0.0:1786400965.419290:0:12882:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc307b800/MGS for MGS 00000020:01000000:0.0:1786400965.419303:0:12882:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:1.0:1786400965.419908:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fcb3ec000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1786400965.420034:0:12882:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1786400965.420039:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786400965.420047:0:12882:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1786400965.420056:0:12882:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9d6ffe129800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1786400965.420063:0:12882:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff9d6fc97b99c0) has exports, disconnecting them 00000020:00080000:0.0:1786400965.420068:0:12882:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9d6ffe129800), last request at 1786400742 00000020:00000080:0.0:1786400965.420074:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5ccaaf4f3cb1d65b 00000020:00080000:0.0:1786400965.421022:0:12882:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d6ffe129800): rc 0 00000020:00000080:0.0:1786400965.421029:0:12882:0:(genops.c:906:class_export_put()) final put ffff9d6ffe129800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1786400965.421887:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ffe129800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1786400965.427154:0:12882:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1786400965.427180:0:12882:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1786400965.427184:0:12882:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1786400965.427193:0:12882:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1786400965.427363:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ffe12e800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1786400965.427367:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1786400965.427377:0:12882:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1786400965.427384:0:12882:0:(genops.c:906:class_export_put()) final put ffff9d6fc28ed800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1786400965.427388:0:12882:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc28ed800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1786400965.427400:0:12882:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1786400965.427460:0:12882:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d6fc307d800 1 00000020:00000080:1.0:1786400965.427466:0:12882:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5ccaaf4f3cb1d582 00000020:00000080:1.0:1786400965.427472:0:12882:0:(genops.c:906:class_export_put()) final put ffff9d6fc307c000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1786400965.427739:0:12882:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1786400965.427744:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1786400965.427750:0:12882:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1786400965.427753:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9d6fc6553380) has no exports 00000020:00000080:3.0:1786400965.428802:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc307c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1786400965.548146:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1786400965.548163:0:12882:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1786400965.548169:0:12882:0:(genops.c:906:class_export_put()) final put ffff9d6fc307e800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1786400965.548175:0:12882:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc307e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1786400965.548187:0:12882:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1786400965.548319:0:12882:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9d6fc307a000 00000020:01000000:3.0:1786400965.548341:0:12882:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1786400965.548346:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1786400965.548351:0:12882:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1786400965.548355:0:12882:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9d6fc523b380) has no exports 00000100:00100000:0.0:1786400965.551069:0:5789:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9d6fc841d200:5789] 1 exiting: rc = 0 00000100:00100000:2.0:1786400965.551440:0:5788:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9d6fc841c400:5788] 0 exiting: rc = 1 00000100:00100000:2.0:1786400965.551510:0:6615:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9d6ec4dd7000:6615] 3 exiting: rc = 0 00000100:00100000:2.0:1786400965.551575:0:5790:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9d6fcb3d1800:5790] 2 exiting: rc = 0 00000100:00100000:2.0:1786400965.552129:0:12795:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9d6fc86c5600:12795] 4 exiting: rc = 0 00000100:00100000:3.0:1786400965.553299:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553309:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553316:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553322:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553327:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553332:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553337:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553342:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553348:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553353:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553358:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553364:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553369:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553375:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553383:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553389:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553394:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553400:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553405:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553411:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553416:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553422:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553428:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553450:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553455:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553461:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553466:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553472:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553478:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553484:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553490:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553495:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553500:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553505:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553511:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553516:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553522:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553528:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553535:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553542:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553548:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553553:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553559:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553565:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553571:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553576:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553581:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553587:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553602:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553608:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553614:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553620:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553626:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553631:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553636:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553640:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553645:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553650:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553663:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553668:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553674:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553680:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553686:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.553691:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1786400965.563198:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786400965.566189:0:5791:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9d6fc841d800:5791] 0 exiting: rc = 1 00000100:00100000:1.0:1786400965.568795:0:5792:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9d6fc841c000:5792] 1 exiting: rc = 0 00000100:00100000:3.0:1786400965.569047:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569055:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569061:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569067:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569075:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569081:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569134:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569140:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569146:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569152:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569159:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569166:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569173:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569178:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569183:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569188:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569194:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569199:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569205:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569210:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569215:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569220:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569226:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569230:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569235:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569240:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569245:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569250:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569255:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569278:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569283:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569288:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569293:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569299:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569304:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569311:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569316:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569320:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569325:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569330:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569335:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569340:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569345:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569351:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569356:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569362:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569367:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569372:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569378:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569383:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569388:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569393:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569399:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569404:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569409:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569414:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569419:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569425:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569430:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569435:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569440:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569446:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569451:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.569456:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.571029:0:5793:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9d6fd2945000:5793] 0 exiting: rc = 1 00000100:00100000:2.0:1786400965.572322:0:5794:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9d6fcb3d0200:5794] 1 exiting: rc = 0 00000100:00100000:3.0:1786400965.572538:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572562:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572569:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572574:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572580:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572586:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572610:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572617:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572622:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572629:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572635:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572641:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572646:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572652:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572658:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572663:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572669:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572674:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572693:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572700:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572706:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572711:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572718:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572724:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572730:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572736:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572742:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572748:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572753:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572759:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572778:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572785:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572790:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572795:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572800:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572817:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572823:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572828:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572835:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572841:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572848:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572854:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572873:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572879:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572885:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572891:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.572897:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.574003:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.574011:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.574018:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.574024:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.574030:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.574035:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.574041:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.574066:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.574075:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.574081:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.574779:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.574788:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.574795:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.574801:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.574807:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.574821:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400965.574870:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.597482:0:5796:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9d6fc3e99c00:5796] 1 exiting: rc = 0 00000100:00100000:1.0:1786400965.597976:0:5795:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9d6fc3e99200:5795] 0 exiting: rc = 1 00000100:00100000:0.0:1786400965.599532:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599542:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599547:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599553:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599558:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599563:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599569:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599574:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599580:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599585:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599602:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599608:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599613:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599618:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599623:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599628:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599633:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599638:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599644:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599649:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599654:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599659:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599664:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599670:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599675:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599680:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599685:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599689:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599693:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599697:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599703:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599708:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599712:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599718:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599735:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599741:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599746:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599751:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599756:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599761:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599766:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599772:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599777:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599782:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599788:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599793:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599798:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599803:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599808:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599813:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599818:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599824:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599828:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599833:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599838:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599843:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599849:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599854:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599859:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599863:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599868:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599873:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599878:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.599883:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.601975:0:5798:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9d6fc3e99400:5798] 1 exiting: rc = 0 00000100:00100000:3.0:1786400965.602495:0:5797:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9d6fc3e99e00:5797] 0 exiting: rc = 1 00000100:00100000:1.0:1786400965.603222:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603231:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603237:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603242:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603246:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603251:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603256:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603261:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603266:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603271:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603276:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603282:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603287:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603293:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603313:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603318:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603323:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603329:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603334:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603340:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603346:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603351:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603357:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603363:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603368:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603373:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603378:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603384:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603389:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603394:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603399:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603404:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603409:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603414:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603419:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603425:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603429:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603435:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603441:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603446:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603451:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603456:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603461:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603467:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603471:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603476:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603481:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603486:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603491:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603503:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603509:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603515:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603519:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603525:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603530:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603534:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603539:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603544:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603549:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603554:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603559:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603564:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603569:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.603574:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.604758:0:5800:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9d6fd020ec00:5800] 1 exiting: rc = 0 00000100:00100000:3.0:1786400965.605413:0:5799:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9d6fd2945400:5799] 0 exiting: rc = 1 00000100:00100000:1.0:1786400965.605657:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605664:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605669:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605675:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605680:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605685:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605690:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605695:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605700:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605706:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605711:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605716:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605722:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605727:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605733:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605738:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605743:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605748:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605753:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605758:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605775:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605780:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605786:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605791:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605796:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605801:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605806:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605811:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605816:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605821:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605825:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605830:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605835:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605840:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605845:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605850:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605855:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605859:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605864:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605868:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605873:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605878:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605884:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605889:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.605894:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.606681:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.606694:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.606699:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.606704:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.606710:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.606715:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.606720:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.606725:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.606730:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.606734:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.606752:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.606757:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.606762:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.606768:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.606773:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.606778:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.606783:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.606789:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400965.606794:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400965.621300:0:5802:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9d6fc3e98e00:5802] 1 exiting: rc = 0 00000100:00100000:0.0:1786400965.622483:0:5803:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9d6fc3e99800:5803] 2 exiting: rc = 0 00000100:00100000:1.0:1786400965.622832:0:5801:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9d6fc3e98800:5801] 0 exiting: rc = 1 00000100:00100000:0.0:1786400965.623760:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.623767:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.623774:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.623795:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.623800:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.623806:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.623811:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.623816:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.623822:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.623827:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.623833:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.623838:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.623844:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.623850:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.623856:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.623861:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.623866:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.623871:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.623895:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.623910:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.623916:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.623922:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.623927:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.623933:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.623938:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.623943:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.623949:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.623955:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.623960:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.623967:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.623972:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.623978:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.623982:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.623988:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.623993:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.623999:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.624004:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.624009:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.624024:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.624029:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.624035:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.624041:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.624061:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.624068:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.624074:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.624080:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.625261:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.625271:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.625276:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.625283:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.625289:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.625295:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.625301:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.625307:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.625312:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.625318:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.625324:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.625330:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.625336:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.625343:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.625348:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.625353:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.625359:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400965.625373:0:12882:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1786400965.644475:0:12882:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1786400965.644490:0:12882:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1786400965.644497:0:12882:0:(genops.c:906:class_export_put()) final put ffff9d6fc28ed000/MDS_uuid 00000020:00000080:2.0:1786400965.644501:0:12882:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc28ed000/MDS_uuid for MDS 00000020:01000000:2.0:1786400965.644512:0:12882:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1786400965.644669:0:12882:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:2.0:1786400965.871615:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786400965.871636:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872173312:0@lo:400:kworker.0 00000400:00000100:2.0:1786400965.871684:0:3308:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1873176872173312 offset 0 length 224: 4 00000100:00100000:2.0:1786400965.871729:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872173440:0@lo:400:kworker.0 00000400:00000100:2.0:1786400965.871746:0:3306:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873176872173440 offset 0 length 224: 4 00000100:00100000:2.0:1786400965.871757:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786400965.871761:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873176872173568:0@lo:400:kworker.0 00000400:00000100:2.0:1786400965.871773:0:3306:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873176872173568 offset 0 length 224: 4 00010000:00010000:1.0:1786400966.576229:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1786400967.506710:0:6619:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1786400967.506723:0:6619:0:(genops.c:906:class_export_put()) final put ffff9d6ec507e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1786400967.506765:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec507e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1786400967.506815:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ec507b800 for lustre-OST0000 00010000:00010000:3.0:1786400967.599259:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400968.623273:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1786400969.284621:0:13038:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1786400969.308817:0:13038:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1786400969.308890:0:13038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e200/0x5ccaaf4f3cb1d8c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d8ca expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400969.309043:0:13038:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e200/0x5ccaaf4f3cb1d8c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d8ca expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400969.309053:0:13038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e200/0x5ccaaf4f3cb1d8c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5ccaaf4f3cb1d8ca expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400969.309060:0:13038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e200/0x5ccaaf4f3cb1d8c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5ccaaf4f3cb1d8ca expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400969.309103:0:13038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1786400969.309110:0:13038:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1786400969.309141:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786400969.309147:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e200/0x5ccaaf4f3cb1d8c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5ccaaf4f3cb1d8ca expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400969.309156:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138e200 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:3.0:1786400969.309160:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e200/0x5ccaaf4f3cb1d8c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5ccaaf4f3cb1d8ca expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400969.309169:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e200/0x5ccaaf4f3cb1d8c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x5ccaaf4f3cb1d8ca expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786400969.309177:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e200/0x5ccaaf4f3cb1d8c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x5ccaaf4f3cb1d8ca expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400969.309255:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1786400969.309257:0:5777:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1786400969.309260:0:5777:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1786400969.309309:0:5777:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e200/0x5ccaaf4f3cb1d8c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5ccaaf4f3cb1d8ca expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400969.309323:0:5777:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1786400969.309685:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e200/0x5ccaaf4f3cb1d8c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5ccaaf4f3cb1d8ca expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400969.309694:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e200/0x5ccaaf4f3cb1d8c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5ccaaf4f3cb1d8ca expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786400969.309839:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd893480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872173696:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786400969.310074:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400969.310078:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400969.310080:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1786400969.310151:0:13038:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1786400969.310162:0:13038:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d6ffde21f80 x1873176872173440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400981 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400969.310404:0:13038:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00100000:3.0:1786400969.310439:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872173440:0@lo:400:kworker.0 00000100:00100000:1.0:1786400969.310560:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786400969.310663:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872173696 00000100:00100000:1.0:1786400969.310673:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872173696 00000100:00080000:3.0:1786400969.310854:0:13038:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1786400969.310878:0:13038:0:(import.c:65:import_set_state_nolock()) ffff9d6ec470c000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1786400969.310905:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd892300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1873176872173824:0@lo:39:umount.0 00000400:00000100:3.0:1786400969.311079:0:3305:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873176872173824 offset 0 length 224: 4 00000100:00100000:1.0:1786400969.311301:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1786400969.311311:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6fe3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3308:x1873176872173696:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1786400969.311320:0:5774:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1786400969 with bad export cookie 6686349351640487340 00000100:00100000:1.0:1786400969.319572:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6fe3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3308:x1873176872173696:12345-0@lo:103:ldlm_bl.0 Request processed in 8251us (9003us total) trans 0 rc -107/-107 00000100:00100000:1.0:1786400969.319587:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1786400969.320826:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.108@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1786400969.320835:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9d6fc28eb800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1786400969.320841:0:3308:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.108@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1786400969.342571:0:3308:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.108@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1786400969.342578:0:3308:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1786400969.342588:0:3308:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d6ffde22300 x1873176872173312/t0(0) o400->MGC192.168.204.108@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1786400981 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400969.343816:0:3308:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d6ffd893480 x1873176872173696/t0(0) o103->MGC192.168.204.108@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1786400985 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1786400969.343826:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1786400969.343829:0:3308:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1786400969.343830:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1786400969.343834:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9d6fc28eb800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786400969.343839:0:3308:0:(import.c:510:import_select_connection()) MGC192.168.204.108@tcp: connect to NID 0@lo last attempt 193 00000100:00080000:0.0:1786400969.343848:0:3308:0:(import.c:624:import_select_connection()) MGC192.168.204.108@tcp: import ffff9d6fc28eb800 using connection 192.168.204.108@tcp/0@lo 00000100:00100000:1.0:1786400969.345775:0:3308:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ff6fe1180 x1873176872173952/t0(0) o250->MGC192.168.204.108@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786400969.345831:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872173312:0@lo:400:kworker.0 00000100:00100000:1.0:1786400969.345876:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd893480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:97b0324f-e214-4822-8711-e150ddac2a7e:3308:1873176872173696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786400969.345978:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:97b0324f-e214-4822-8711-e150ddac2a7e:3305:1873176872173952:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1786400969.346029:0:3305:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1873176872173952 offset 0 length 520: 4 00010000:00010000:1.0:1786400969.646567:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400970.670693:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1786400970.990261:0:12743:0:(pinger.c:229:ptlrpc_pinger_process_import()) 97b0324f-e214-4822-8711-e150ddac2a7e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1786400970.991190:0:12743:0:(pinger.c:247:ptlrpc_pinger_process_import()) 97b0324f-e214-4822-8711-e150ddac2a7e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1786400970.991281:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873176872174080:0@lo:400:kworker.0 00000400:00000100:1.0:1786400970.991336:0:3309:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873176872174080 offset 0 length 224: 4 00010000:00010000:1.0:1786400971.694265:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400972.718345:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400973.742259:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1786400973.999274:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 97b0324f-e214-4822-8711-e150ddac2a7e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786400973.999284:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 97b0324f-e214-4822-8711-e150ddac2a7e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1786400973.999392:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873176872174208:0@lo:400:kworker.0 00000400:00000100:3.0:1786400973.999463:0:3306:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873176872174208 offset 0 length 224: 4 00010000:00010000:3.0:1786400974.766661:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400975.790241:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400976.815716:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400977.838246:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400978.862366:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1786400979.182389:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 97b0324f-e214-4822-8711-e150ddac2a7e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786400979.182399:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 97b0324f-e214-4822-8711-e150ddac2a7e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1786400979.182860:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786400979.182893:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873176872174336:0@lo:400:kworker.0 00000400:00000100:2.0:1786400979.182968:0:3306:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873176872174336 offset 0 length 224: 4 00000100:00100000:0.0:1786400979.694256:0:3305:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786400969/real 1786400969] req@ffff9d6ff6fe1180 x1873176872173952/t0(0) o250->MGC192.168.204.108@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1786400979 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400979.694299:0:3305:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d6ff6fe1180 x1873176872173952/t0(0) o250->MGC192.168.204.108@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1786400979 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400979.694326:0:3305:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786400969/real 1786400969] req@ffff9d6ffd892300 x1873176872173824/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1786400979 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400979.694340:0:3305:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d6ffd892300 x1873176872173824/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1786400979 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1786400979.694363:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9d6fc28eb800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1786400979.694388:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1786400979.694393:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:97b0324f-e214-4822-8711-e150ddac2a7e:3305:1873176872173952:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:0.0:1786400979.694399:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9d6ec470c000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1786400979.694426:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd892300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1873176872173824:0@lo:39:umount.0 00000100:00080000:1.0:1786400979.694589:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 97b0324f-e214-4822-8711-e150ddac2a7e->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1786400979.694596:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1786400979.694599:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d6fc28eb800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786400979.694605:0:8:0:(import.c:510:import_select_connection()) MGC192.168.204.108@tcp: connect to NID 0@lo last attempt 421 00000100:00080000:1.0:1786400979.694610:0:8:0:(import.c:589:import_select_connection()) MGC192.168.204.108@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1786400979.694619:0:8:0:(import.c:624:import_select_connection()) MGC192.168.204.108@tcp: import ffff9d6fc28eb800 using connection 192.168.204.108@tcp/0@lo 00000100:00100000:1.0:1786400979.694670:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ff6fe0a80 x1873176872174464/t0(0) o250->MGC192.168.204.108@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786400979.694742:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786400979.694757:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873176872174592:0@lo:400:kworker.0 00000400:00000100:1.0:1786400979.694821:0:3309:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873176872174592 offset 0 length 224: 4 00000100:00100000:0.0:1786400979.694944:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:97b0324f-e214-4822-8711-e150ddac2a7e:3305:1873176872174464:0@lo:250:kworker.0 00000400:00000100:0.0:1786400979.694971:0:3305:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1873176872174464 offset 0 length 520: 4 00000100:00080000:3.0:1786400979.695055:0:13038:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1786400979.695061:0:13038:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1786400979.695066:0:13038:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1786400979.696026:0:13038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d70020e4200/0x5ccaaf4f3cb1d8d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d8d8 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400979.696046:0:13038:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d70020e4200/0x5ccaaf4f3cb1d8d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d8d8 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400979.696054:0:13038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d70020e4200/0x5ccaaf4f3cb1d8d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5ccaaf4f3cb1d8d8 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400979.696061:0:13038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.108@tcp lock: ffff9d70020e4200/0x5ccaaf4f3cb1d8d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5ccaaf4f3cb1d8d8 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400979.696120:0:13038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786400979.696128:0:13038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39000/0x5ccaaf4f3cb1dafa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1db01 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400979.696135:0:13038:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39000/0x5ccaaf4f3cb1dafa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1db01 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400979.696141:0:13038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39000/0x5ccaaf4f3cb1dafa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5ccaaf4f3cb1db01 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400979.696170:0:13038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39000/0x5ccaaf4f3cb1dafa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5ccaaf4f3cb1db01 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400979.697372:0:13038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1786400979.697387:0:13038:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1786400979.697631:0:13038:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1786400979.697638:0:13038:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1786400979.697647:0:13038:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1786400979.697654:0:13038:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1786400979.697659:0:13038:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9d6fc6550000) has no exports 00000020:00080000:3.0:1786400979.697700:0:13038:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9d6fc6550000) has no exports 00010000:00010000:0.0:1786400979.701218:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786400979.701259:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d70020e4200/0x5ccaaf4f3cb1d8d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5ccaaf4f3cb1d8d8 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400979.701274:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d70020e4200 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:0.0:1786400979.701279:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d70020e4200/0x5ccaaf4f3cb1d8d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5ccaaf4f3cb1d8d8 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400979.701291:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d70020e4200/0x5ccaaf4f3cb1d8d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5ccaaf4f3cb1d8d8 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786400979.701299:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d70020e4200/0x5ccaaf4f3cb1d8d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5ccaaf4f3cb1d8d8 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786400979.701305:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1786400979.701308:0:5777:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1786400979.701320:0:5777:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1786400979.701345:0:5777:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d6fc28eb800 00010000:00010000:0.0:1786400979.701350:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d70020e4200/0x5ccaaf4f3cb1d8d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x5ccaaf4f3cb1d8d8 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400979.701358:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d70020e4200/0x5ccaaf4f3cb1d8d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x5ccaaf4f3cb1d8d8 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400979.701375:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786400979.701380:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39000/0x5ccaaf4f3cb1dafa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5ccaaf4f3cb1db01 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400979.701386:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7d39000 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:0.0:1786400979.701389:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39000/0x5ccaaf4f3cb1dafa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5ccaaf4f3cb1db01 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400979.701406:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39000/0x5ccaaf4f3cb1dafa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5ccaaf4f3cb1db01 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786400979.701413:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39000/0x5ccaaf4f3cb1dafa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5ccaaf4f3cb1db01 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786400979.701725:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1786400979.701728:0:5777:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1786400979.701730:0:5777:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1786400979.701738:0:5777:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d6fc28eb800 00010000:00010000:0.0:1786400979.701741:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39000/0x5ccaaf4f3cb1dafa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5ccaaf4f3cb1db01 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400979.701748:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39000/0x5ccaaf4f3cb1dafa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5ccaaf4f3cb1db01 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400979.701760:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400979.701762:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786400979.701764:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400979.705219:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1786400979.705546:0:13038:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9d6fc95c89c0 - data ffff9d7000be95e8/ffff9d6ffd65a400 00000020:01000000:3.0:1786400979.705817:0:13038:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9d6fc4bfe5a0 - data ffff9d6febfbfbd0/ffff9d6ec4d4fc00 00100000:10000000:3.0:1786400979.715390:0:13038:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1786400979.778851:0:13038:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5ccaaf4f3cb1d6e0 00000020:00000080:3.0:1786400979.778864:0:13038:0:(genops.c:906:class_export_put()) final put ffff9d6ec4e1a800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1786400979.779293:0:13038:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d6fc49f0000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1786400979.779300:0:13038:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d6fc49f0000 2 00000020:01000004:3.0:1786400979.779304:0:13038:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d6fc49f0000 from lustre-OST0000 00000020:00000080:3.0:1786400979.779366:0:13038:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1786400979.779380:0:13038:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1786400979.779384:0:13038:0:(genops.c:906:class_export_put()) final put ffff9d6ec470c800/lustre-OST0000_UUID 00000020:00000080:3.0:1786400979.779388:0:13038:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec470c800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1786400979.779399:0:13038:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1786400979.779484:0:13038:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1786400979.779490:0:13038:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1786400979.779495:0:13038:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1786400979.779501:0:13038:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1786400979.779510:0:13038:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9d6ec4709800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1786400979.779533:0:13038:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff9d6fc5238000) has exports, disconnecting them 00000020:00080000:3.0:1786400979.779539:0:13038:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9d6ec4709800), last request at 1786400758 00000020:00000080:3.0:1786400979.779544:0:13038:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5ccaaf4f3cb1d70a 00000020:00080000:3.0:1786400979.779556:0:13038:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d6ec4709800): rc 0 00000020:00000080:3.0:1786400979.779562:0:13038:0:(genops.c:906:class_export_put()) final put ffff9d6ec4709800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1786400979.780370:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec4e1a800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00010000:01000000:2.0:1786400979.784235:0:13038:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1786400979.784248:0:13038:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1786400979.784253:0:13038:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1786400979.784263:0:13038:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1786400979.784681:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec4709800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1786400979.785290:0:13038:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1786400979.785302:0:13038:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1786400979.785322:0:13038:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d6fc49f0000 1 00000020:00000080:2.0:1786400979.785330:0:13038:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5ccaaf4f3cb1d69a 00000020:00000080:2.0:1786400979.785340:0:13038:0:(genops.c:906:class_export_put()) final put ffff9d6fc3371000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1786400979.786584:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ec470c000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1786400979.786615:0:8:0:(genops.c:906:class_export_put()) final put ffff9d6ff6925800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1786400979.786618:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ff6925800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1786400979.786628:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1786400979.787264:0:13038:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1786400979.787274:0:13038:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1786400979.787286:0:13038:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1786400979.787291:0:13038:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9d6fe9038000) has no exports 00000020:00000080:1.0:1786400979.787805:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc3371000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1786400979.870151:0:13038:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1786400979.870176:0:13038:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1786400979.870182:0:13038:0:(genops.c:906:class_export_put()) final put ffff9d6fc3374000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1786400979.870188:0:13038:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc3374000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1786400979.870201:0:13038:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1786400979.870406:0:13038:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9d6fc3375800 00000020:02000400:2.0:1786400979.870469:0:13038:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1786400979.916578:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400980.974261:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1786400981.231313:0:3306:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786400965/real 1786400965] req@ffff9d6ffde22d80 x1873176872173568/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1786400981 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400981.271972:0:3306:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9d6ffde22d80 x1873176872173568/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1786400981 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1786400981.271987:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9d6ec5079000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1786400981.271992:0:3306:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1786400981.289687:0:3306:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00080000:2.0:1786400981.289724:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 97b0324f-e214-4822-8711-e150ddac2a7e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786400981.289730:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 97b0324f-e214-4822-8711-e150ddac2a7e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1786400981.289733:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1786400981.289736:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1786400981.289740:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d6ec5079000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786400981.289749:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 228 00000100:00080000:2.0:1786400981.289759:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9d6ec5079000 using connection 192.168.204.108@tcp/0@lo 00000100:00100000:2.0:1786400981.289802:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ffde20a80 x1873176872174720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786400981.293165:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873176872173568:0@lo:400:kworker.0 00000100:00100000:2.0:1786400981.294335:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1873176872174720:0@lo:38:kworker.0 00000400:00000100:2.0:1786400981.294478:0:3305:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873176872174720 offset 0 length 520: 4 00010000:00010000:1.0:1786400981.998203:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1786400982.751616:0:13190:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1786400982.769076:0:13190:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1786400982.769657:0:13190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39c00/0x5ccaaf4f3cb1d8a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d8ae expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400982.769673:0:13190:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39c00/0x5ccaaf4f3cb1d8a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d8ae expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400982.769682:0:13190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39c00/0x5ccaaf4f3cb1d8a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5ccaaf4f3cb1d8ae expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400982.769690:0:13190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39c00/0x5ccaaf4f3cb1d8a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5ccaaf4f3cb1d8ae expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400982.769726:0:13190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1786400982.769732:0:13190:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1786400982.769930:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786400982.769939:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39c00/0x5ccaaf4f3cb1d8a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5ccaaf4f3cb1d8ae expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400982.769946:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7d39c00 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:1.0:1786400982.769951:0:5776:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39c00/0x5ccaaf4f3cb1d8a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5ccaaf4f3cb1d8ae expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400982.769960:0:5776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39c00/0x5ccaaf4f3cb1d8a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5ccaaf4f3cb1d8ae expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786400982.769968:0:5776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39c00/0x5ccaaf4f3cb1d8a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5ccaaf4f3cb1d8ae expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1786400982.770060:0:13190:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1786400982.770072:0:13190:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d6ffd891880 x1873176872174080/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400986 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400982.770122:0:13190:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d6ffde22a00 x1873176872174208/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400989 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786400982.770172:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873176872174208:0@lo:400:kworker.0 10000000:01000000:1.0:1786400982.770243:0:5776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1786400982.770246:0:5776:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1786400982.770248:0:5776:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1786400982.770272:0:5776:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d6fc28eb800 00010000:00010000:1.0:1786400982.770277:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39c00/0x5ccaaf4f3cb1d8a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5ccaaf4f3cb1d8ae expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400982.770283:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fe7d39c00/0x5ccaaf4f3cb1d8a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5ccaaf4f3cb1d8ae expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786400982.770300:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400982.770302:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786400982.770304:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786400982.770353:0:13190:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d6ff6fe1c00 x1873176872174336/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400995 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400982.770373:0:13190:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d6ff6fe1500 x1873176872174592/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786400995 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786400982.770470:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873176872174080:0@lo:400:kworker.0 00000100:00100000:0.0:1786400982.770497:0:13190:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d6ffde20a80 x1873176872174720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1786400991 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400982.770515:0:13190:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1786400982.770521:0:13190:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1786400982.770623:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873176872174336:0@lo:400:kworker.0 00000100:00100000:2.0:1786400982.770628:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873176872174592:0@lo:400:kworker.0 00000100:00080000:0.0:1786400982.770671:0:13190:0:(import.c:65:import_set_state_nolock()) ffff9d6ec5079000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1786400982.770679:0:13190:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1786400982.770684:0:13190:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d6ffde20a80 x1873176872174720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1786400991 ref 1 fl Interpret:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786400982.770693:0:13190:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1786400982.770697:0:13190:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1786400982.770800:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1873176872174720:0@lo:38:kworker.0 00010000:00010000:0.0:1786400982.772024:0:13190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5c600/0x5ccaaf4f3cb1d8b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1d8bc expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400982.772037:0:13190:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5c600/0x5ccaaf4f3cb1d8b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1d8bc expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400982.772060:0:13190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5c600/0x5ccaaf4f3cb1d8b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5ccaaf4f3cb1d8bc expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400982.772067:0:13190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5c600/0x5ccaaf4f3cb1d8b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5ccaaf4f3cb1d8bc expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400982.772336:0:13190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786400982.772346:0:13190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1daec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1daf3 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400982.772421:0:13190:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1daec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1daf3 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400982.772430:0:13190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1daec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5ccaaf4f3cb1daf3 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400982.772437:0:13190:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1daec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5ccaaf4f3cb1daf3 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400982.772625:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786400982.772633:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5c600/0x5ccaaf4f3cb1d8b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5ccaaf4f3cb1d8bc expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400982.772641:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5c600 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:2.0:1786400982.772645:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5c600/0x5ccaaf4f3cb1d8b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5ccaaf4f3cb1d8bc expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400982.772653:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5c600/0x5ccaaf4f3cb1d8b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5ccaaf4f3cb1d8bc expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786400982.772672:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5c600/0x5ccaaf4f3cb1d8b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5ccaaf4f3cb1d8bc expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786400982.772677:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1786400982.772679:0:5777:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1786400982.772690:0:5777:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d6fc28eb800 00010000:00010000:2.0:1786400982.772694:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5c600/0x5ccaaf4f3cb1d8b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5ccaaf4f3cb1d8bc expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786400982.772701:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5c600/0x5ccaaf4f3cb1d8b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5ccaaf4f3cb1d8bc expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400982.772893:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786400982.772899:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1daec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5ccaaf4f3cb1daf3 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400982.772905:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5da00 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:3.0:1786400982.772909:0:5777:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1daec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5ccaaf4f3cb1daf3 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400982.772917:0:5777:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1daec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5ccaaf4f3cb1daf3 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786400982.772924:0:5777:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1daec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5ccaaf4f3cb1daf3 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400982.772929:0:5777:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1786400982.772932:0:5777:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1786400982.772937:0:5777:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d6fc28eb800 00010000:00010000:3.0:1786400982.772940:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1daec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5ccaaf4f3cb1daf3 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786400982.773265:0:13190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:0.0:1786400982.773271:0:13190:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1786400982.773275:0:13190:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1786400982.773278:0:13190:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1786400982.773306:0:13190:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1786400982.773311:0:13190:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1786400982.773318:0:13190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786400982.773323:0:13190:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1786400982.773328:0:13190:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9d6fc6554d40) has no exports 00000020:00080000:0.0:1786400982.773356:0:13190:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9d6fc6554d40) has no exports 00010000:00010000:3.0:1786400982.775286:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1daec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5ccaaf4f3cb1daf3 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400982.775314:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400982.775317:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1786400982.776692:0:13190:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9d6fc8465480 - data ffff9d7000ab7e58/ffff9d6ffe8af800 00000020:01000000:0.0:1786400982.777561:0:13190:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9d6ffced2900 - data ffff9d7000bece58/ffff9d6fedca3000 00010000:00010000:1.0:1786400982.779229:0:5776:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786400982.779661:0:5777:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1786400982.804594:0:13190:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1786400982.830492:0:13190:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5ccaaf4f3cb1d7ab 00000020:00000080:3.0:1786400982.830503:0:13190:0:(genops.c:906:class_export_put()) final put ffff9d6fc329b800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1786400982.830531:0:13190:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d6ec470a000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1786400982.830536:0:13190:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d6ec470a000 2 00000020:01000004:3.0:1786400982.830539:0:13190:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d6ec470a000 from lustre-OST0001 00000020:00000080:3.0:1786400982.830563:0:13190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1786400982.830573:0:13190:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1786400982.830576:0:13190:0:(genops.c:906:class_export_put()) final put ffff9d6fc329c800/lustre-OST0001_UUID 00000020:00000080:3.0:1786400982.830580:0:13190:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc329c800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1786400982.830586:0:13190:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1786400982.830799:0:13190:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 97b0324f-e214-4822-8711-e150ddac2a7e->MGS 00010000:00010000:3.0:1786400982.830817:0:13190:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fc138ec00/0x5ccaaf4f3cb1d6bd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5ccaaf4f3cb1d6c4 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786400982.830830:0:13190:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc138ec00/0x5ccaaf4f3cb1d6bd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5ccaaf4f3cb1d6c4 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400982.830837:0:13190:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1786400982.830840:0:13190:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1786400982.830844:0:13190:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1786400982.830860:0:13190:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d6fc28eb800 00010000:00010000:3.0:1786400982.830864:0:13190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fc138ec00/0x5ccaaf4f3cb1d6bd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5ccaaf4f3cb1d6c4 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786400982.830896:0:13190:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1d8fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5ccaaf4f3cb1d902 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1786400982.830904:0:13190:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1d8fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5ccaaf4f3cb1d902 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786400982.830909:0:13190:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1786400982.830912:0:13190:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1786400982.830913:0:13190:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1786400982.830924:0:13190:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d6fc28eb800 00010000:00010000:3.0:1786400982.830927:0:13190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1d8fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5ccaaf4f3cb1d902 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1786400982.830943:0:13190:0:(import.c:65:import_set_state_nolock()) ffff9d6fc28eb800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1786400982.830948:0:13190:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1786400982.830950:0:13190:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1786400982.830952:0:13190:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1786400982.830956:0:13190:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1786400982.830970:0:13190:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d6ff6fe0a80 x1873176872174464/t0(0) o250->MGC192.168.204.108@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1786400994 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1786400982.830992:0:13190:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1786400982.830995:0:13190:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000020:00000080:2.0:1786400982.831050:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc329b800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1786400982.831440:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:97b0324f-e214-4822-8711-e150ddac2a7e:3305:1873176872174464:0@lo:250:kworker.0 10000000:01000000:3.0:1786400982.831505:0:13190:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1786400982.831513:0:13190:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5ccaaf4f3cb1d59e 00000020:00000080:3.0:1786400982.831517:0:13190:0:(genops.c:906:class_export_put()) final put ffff9d6fc28e8800/97b0324f-e214-4822-8711-e150ddac2a7e 00000020:01000000:3.0:1786400982.831534:0:13190:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.204.108@tcp (flags='') 00000020:00000080:3.0:1786400982.831539:0:13190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1786400982.831544:0:13190:0:(obd_config.c:955:class_cleanup()) MGC192.168.204.108@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1786400982.831548:0:13190:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9d6fc523cd40) has no exports 00000020:00000080:2.0:1786400982.831596:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc28e8800/97b0324f-e214-4822-8711-e150ddac2a7e for MGC192.168.204.108@tcp 10000000:01000000:0.0:1786400982.831640:0:5785:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1786400982.831798:0:13190:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.204.108@tcp: client import never connected 00000100:00080000:3.0:1786400982.831808:0:13190:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1786400982.831811:0:13190:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1786400982.831813:0:13190:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1786400982.831815:0:13190:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1786400982.831845:0:13190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1786400982.831851:0:13190:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.108@tcp (uuid 97b0324f-e214-4822-8711-e150ddac2a7e) 00000020:01000000:3.0:1786400982.831856:0:13190:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1786400982.831859:0:13190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1786400982.831862:0:13190:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1786400982.831867:0:13190:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9d6fc3370800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1786400982.831872:0:13190:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff9d6fe903b380) has exports, disconnecting them 00000020:00080000:3.0:1786400982.831877:0:13190:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9d6fc3370800), last request at 1786400776 00000020:00000080:3.0:1786400982.831881:0:13190:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5ccaaf4f3cb1d7d5 00000020:00080000:3.0:1786400982.831892:0:13190:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d6fc3370800): rc 0 00000020:00000080:3.0:1786400982.831895:0:13190:0:(genops.c:906:class_export_put()) final put ffff9d6fc3370800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1786400982.832170:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc3370800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1786400982.833017:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6fc28eb800 for MGC192.168.204.108@tcp 00000020:00000080:0.0:1786400982.833026:0:8:0:(genops.c:906:class_export_put()) final put ffff9d6fc28ea800/97b0324f-e214-4822-8711-e150ddac2a7e 00000020:00000080:0.0:1786400982.833028:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc28ea800/97b0324f-e214-4822-8711-e150ddac2a7e for MGC192.168.204.108@tcp 00000020:01000000:0.0:1786400982.833034:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.108@tcp (97b0324f-e214-4822-8711-e150ddac2a7e) 00010000:01000000:2.0:1786400982.834137:0:13190:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1786400982.834144:0:13190:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1786400982.834148:0:13190:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1786400982.834155:0:13190:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1786400982.834301:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ec5079000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1786400982.834360:0:5776:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1786400982.834603:0:5777:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:0.0:1786400982.834842:0:5771:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9d6fc8580000:5771] 0 exiting: rc = 1 00000100:00100000:0.0:1786400982.836181:0:8368:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9d6fc3207c00:8368] 2 exiting: rc = 0 00000100:00100000:2.0:1786400982.837168:0:5772:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9d6fc8580a00:5772] 1 exiting: rc = 0 00000100:00100000:0.0:1786400982.837303:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.837575:0:5773:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9d6fc8580200:5773] 0 exiting: rc = 1 00000100:00100000:1.0:1786400982.837693:0:5774:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9d6fc8581000:5774] 1 exiting: rc = 0 00000100:00100000:2.0:1786400982.838274:0:5775:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9d6fc8580400:5775] 2 exiting: rc = 0 00000100:00100000:2.0:1786400982.841211:0:8369:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9d6ec47cf400:8369] 3 exiting: rc = 0 00000100:00100000:0.0:1786400982.841402:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841413:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841419:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841425:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841431:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841437:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841442:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841446:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841451:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841457:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841462:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841468:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841474:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841480:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841486:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841493:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841499:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841504:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841510:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841528:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841533:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841539:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841544:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841549:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841555:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841559:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841565:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841570:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841575:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841580:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841585:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841590:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841595:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841600:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841606:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841611:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841616:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841621:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841626:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841631:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841636:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841642:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841647:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841652:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841657:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841662:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841667:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841673:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841693:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841700:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841706:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841710:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841715:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841720:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841733:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841738:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841743:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841747:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841751:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841756:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841761:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841765:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841770:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.841775:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1786400982.842882:0:13190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1786400982.842893:0:13190:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1786400982.842898:0:13190:0:(genops.c:906:class_export_put()) final put ffff9d6ffd5a7800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1786400982.842903:0:13190:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ffd5a7800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1786400982.842914:0:13190:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1786400982.842958:0:13190:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d6ec470a000 1 00000020:00000080:0.0:1786400982.842964:0:13190:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5ccaaf4f3cb1d77a 00000020:00000080:0.0:1786400982.843030:0:13190:0:(genops.c:906:class_export_put()) final put ffff9d6ec5079800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1786400982.843192:0:13190:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1786400982.843198:0:13190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1786400982.843204:0:13190:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1786400982.843208:0:13190:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9d6fc33f3380) has no exports 00000020:00000080:2.0:1786400982.843386:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec5079800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1786400982.854656:0:13190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1786400982.854755:0:13190:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1786400982.854760:0:13190:0:(genops.c:906:class_export_put()) final put ffff9d6ec4708800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1786400982.855052:0:13190:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec4708800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1786400982.855102:0:13190:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1786400982.855608:0:13190:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9d6ec470d800 00000020:01000000:2.0:1786400982.855650:0:13190:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1786400982.855773:0:13190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1786400982.855778:0:13190:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1786400982.855782:0:13190:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9d6fe903cd40) has no exports 00000020:00000080:2.0:1786400982.855809:0:13190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1786400982.855815:0:13190:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1786400982.855818:0:13190:0:(genops.c:906:class_export_put()) final put ffff9d6fc3371800/OSS_uuid 00000020:00000080:2.0:1786400982.855820:0:13190:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc3371800/OSS_uuid for OSS 00000020:01000000:2.0:1786400982.855824:0:13190:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1786400982.855896:0:6593:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9d6fc3201a00:6593] 2 exiting: rc = 0 00000100:00100000:0.0:1786400982.857619:0:6592:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9d6fc3200600:6592] 1 exiting: rc = 0 00000100:00080000:3.0:1786400982.857799:0:5784:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1786400982.857836:0:11770:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9d6fee341400:11770] 3 exiting: rc = 0 00000100:00100000:3.0:1786400982.857906:0:6590:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9d6fc65faa00:6590] 0 exiting: rc = 1 00000100:00100000:2.0:1786400982.858083:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858128:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858193:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858201:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858206:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858211:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858215:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858220:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858224:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858228:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858233:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858237:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858242:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858246:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858260:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858265:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858269:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858274:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858279:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858284:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858289:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858303:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858307:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858312:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858316:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858321:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858325:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858329:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858333:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858337:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858341:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858345:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858351:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858355:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858360:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858364:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858369:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858373:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858377:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858382:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858386:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858390:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858395:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858399:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858403:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858407:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858411:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858415:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858419:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858424:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858430:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858434:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858439:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858470:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858475:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858480:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858490:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858495:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858500:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858505:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858509:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858514:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858518:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.858526:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.859890:0:6594:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9d6fc3200a00:6594] 0 exiting: rc = 1 00000100:00100000:3.0:1786400982.860063:0:6595:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9d6fc5681400:6595] 1 exiting: rc = 0 00000100:00100000:2.0:1786400982.860236:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860242:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860247:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860264:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860269:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860274:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860284:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860289:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860294:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860335:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860342:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860347:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860352:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860357:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860362:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860372:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860377:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860382:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860386:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860391:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860395:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860400:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860404:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860409:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860414:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860418:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860423:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860435:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860439:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860444:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860448:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860453:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860457:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860462:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860466:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860509:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860515:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860519:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860524:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860529:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860534:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860539:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860545:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860550:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860555:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860559:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860564:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860570:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860577:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860583:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860591:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860596:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860600:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860605:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860610:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860614:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860619:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860623:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860628:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860632:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860637:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860641:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860654:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.860659:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.862206:0:6596:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9d6fc3201000:6596] 0 exiting: rc = 1 00000100:00100000:3.0:1786400982.862230:0:6598:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9d6fc85de200:6598] 2 exiting: rc = 0 00000100:00100000:0.0:1786400982.862364:0:6597:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9d6fc3200800:6597] 1 exiting: rc = 0 00000100:00100000:3.0:1786400982.862451:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862458:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862464:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862470:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862476:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862482:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862488:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862494:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862499:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862505:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862510:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862516:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862521:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862536:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862542:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862548:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862554:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862559:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862565:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862570:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862576:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862581:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862586:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862592:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862597:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862603:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862609:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862614:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862619:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862637:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862645:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862650:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862655:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862666:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862670:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862756:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862764:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862770:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862776:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862785:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862791:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862797:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862802:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862808:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862814:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862819:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862825:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862830:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862842:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862847:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862854:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862859:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862865:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862885:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862896:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862902:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862907:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862912:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862918:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862923:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862929:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862935:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862940:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1786400982.862946:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400982.867792:0:6599:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9d6fc4e6b000:6599] 0 exiting: rc = 1 00000100:00100000:3.0:1786400982.867919:0:6600:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9d6fc9f47400:6600] 1 exiting: rc = 0 00000100:00100000:2.0:1786400982.868184:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868192:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868199:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868204:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868209:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868214:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868220:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868225:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868229:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868240:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868247:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868264:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868270:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868276:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868281:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868286:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868291:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868296:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868302:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868307:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868313:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868319:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868324:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868329:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868334:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868339:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868364:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868370:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868374:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868379:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868384:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868389:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868394:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868410:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868416:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868421:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868426:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868430:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868435:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868440:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868445:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868450:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868455:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868460:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868466:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868471:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868476:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868481:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868485:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868490:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868495:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868500:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868510:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868516:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868523:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868528:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868535:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868543:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868549:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868557:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868565:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868571:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868576:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1786400982.868581:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1786400982.870863:0:6601:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9d6fc4802a00:6601] 0 exiting: rc = 1 00000100:00100000:1.0:1786400982.871576:0:6602:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9d6fd0251200:6602] 1 exiting: rc = 0 00000100:00100000:0.0:1786400982.871635:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.871642:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.871649:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.871656:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.871662:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.871669:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.871789:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.871795:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.871805:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.871811:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.871818:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.871826:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.871832:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.871941:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.871965:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872044:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872051:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872057:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872063:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872070:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872075:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872082:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872167:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872173:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872179:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872186:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872209:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872216:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872222:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872229:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872235:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872241:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872247:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872263:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872269:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872398:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872407:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872413:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872434:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872442:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872448:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872461:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872467:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872473:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872480:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872485:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872491:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872497:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872503:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872508:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872530:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872537:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872542:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872548:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872553:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872560:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872565:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872570:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872576:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872580:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872591:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872599:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872606:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1786400982.872612:0:13190:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1786400982.887209:0:13190:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1786400999.423413:0:13808:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg408-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1786401008.211146:0:14223:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1786401008.211233:0:14223:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1786401008.211501:0:14223:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9d6ec4cf8800 00000020:01000004:3.0:1786401008.211517:0:14223:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1786401008.211525:0:14223:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1786401008.211540:0:14223:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9d6fc97bb380) 00000020:00000080:3.0:1786401008.211554:0:14223:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1786401008.238913:0:14223:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1786401008.242650:0:14223:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1786401008.243522:0:14223:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1786401008.243598:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 365: rc = 0 00100000:10000000:3.0:1786401008.243703:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 365: rc = 0 00100000:10000000:3.0:1786401008.243823:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 365: rc = 0 00100000:10000000:3.0:1786401008.243952:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 365: rc = 0 00100000:10000000:3.0:1786401008.245889:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 365: rc = 0 00100000:10000000:3.0:1786401008.246301:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 365: rc = 0 00100000:10000000:3.0:1786401008.246569:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 367: rc = 0 00100000:10000000:3.0:1786401008.247721:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 643: rc = 0 00100000:10000000:3.0:1786401008.248241:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 643: rc = 0 00100000:10000000:3.0:1786401008.248802:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 518: rc = 0 00100000:10000000:3.0:1786401008.249323:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 518: rc = 0 00100000:10000000:3.0:1786401008.249905:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 518: rc = 0 00100000:10000000:3.0:1786401008.250316:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 518: rc = 0 00100000:10000000:3.0:1786401008.250573:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 518: rc = 0 00100000:10000000:3.0:1786401008.252874:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 518: rc = 0 00100000:10000000:3.0:1786401008.254038:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 518: rc = 0 00100000:10000000:3.0:1786401008.254567:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 518: rc = 0 00100000:10000000:3.0:1786401008.255063:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 518: rc = 0 00100000:10000000:3.0:1786401008.255364:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 518: rc = 0 00100000:10000000:3.0:1786401008.255939:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 518: rc = 0 00100000:10000000:3.0:1786401008.256380:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 518: rc = 0 00100000:10000000:3.0:1786401008.257066:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 240: rc = 0 00100000:10000000:3.0:1786401008.258941:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 240: rc = 0 00100000:10000000:3.0:1786401008.264245:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 240: rc = 0 00100000:10000000:3.0:1786401008.264607:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 240: rc = 0 00100000:10000000:3.0:1786401008.264895:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 240: rc = 0 00100000:10000000:3.0:1786401008.265208:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 240: rc = 0 00100000:10000000:3.0:1786401008.265461:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 240: rc = 0 00100000:10000000:3.0:1786401008.265724:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 240: rc = 0 00100000:10000000:3.0:1786401008.266000:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 240: rc = 0 00100000:10000000:3.0:1786401008.266293:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 240: rc = 0 00100000:10000000:3.0:1786401008.266538:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 240: rc = 0 00100000:10000000:3.0:1786401008.269853:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 240: rc = 0 00100000:10000000:3.0:1786401008.270606:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 240: rc = 0 00100000:10000000:3.0:1786401008.271498:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 240: rc = 0 00100000:10000000:3.0:1786401008.272043:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 240: rc = 0 00100000:10000000:3.0:1786401008.272352:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 240: rc = 0 00100000:10000000:3.0:1786401008.274254:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 240: rc = 0 00100000:10000000:3.0:1786401008.275783:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 240: rc = 0 00100000:10000000:3.0:1786401008.276080:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 240: rc = 0 00100000:10000000:2.0:1786401008.277052:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 240: rc = 0 00100000:10000000:2.0:1786401008.278741:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 240: rc = 0 00100000:10000000:2.0:1786401008.279029:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 240: rc = 0 00100000:10000000:2.0:1786401008.280537:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 240: rc = 0 00100000:10000000:2.0:1786401008.281632:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 240: rc = 0 00100000:10000000:2.0:1786401008.282894:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 240: rc = 0 00100000:10000000:2.0:1786401008.283873:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 240: rc = 0 00100000:10000000:2.0:1786401008.284924:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 240: rc = 0 00100000:10000000:2.0:1786401008.285920:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 240: rc = 0 00100000:10000000:2.0:1786401008.286230:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 240: rc = 0 00100000:10000000:2.0:1786401008.288404:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 240: rc = 0 00100000:10000000:2.0:1786401008.288806:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 240: rc = 0 00100000:10000000:2.0:1786401008.289073:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 240: rc = 0 00100000:10000000:2.0:1786401008.290991:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 237: rc = 0 00100000:10000000:2.0:1786401008.294420:0:14223:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1786401008.294617:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 644: rc = 0 00100000:10000000:2.0:1786401008.294950:0:14223:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1786401008.295018:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 644: rc = 0 00100000:10000000:2.0:1786401008.295301:0:14223:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1786401008.295367:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 644: rc = 0 00100000:10000000:2.0:1786401008.295830:0:14223:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1786401008.295896:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 647: rc = 0 00100000:10000000:2.0:1786401008.296123:0:14223:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1786401008.296193:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 647: rc = 0 00100000:10000000:2.0:1786401008.296384:0:14223:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1786401008.296448:0:14223:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 647: rc = 0 00000020:00000080:2.0:1786401008.298067:0:14223:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1786401008.298076:0:14223:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1786401008.298474:0:14223:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5ccaaf4f3cb1e89f 00000020:01000004:2.0:1786401008.298483:0:14223:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1786401008.298489:0:14223:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1786401008.298495:0:14223:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d6ec4cf8800 from MGS 00000020:01000004:2.0:1786401008.298498:0:14223:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1786401008.298510:0:14223:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9d6fe9038000) 00000020:00000080:2.0:1786401008.298522:0:14223:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1786401008.298581:0:14223:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d6ec4cf8800 from MGS, refs=2 00080000:01000000:2.0:1786401008.298587:0:14223:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1786401008.298591:0:14223:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5ccaaf4f3cb1e8ad 00000100:00100000:2.0:1786401008.299632:0:14223:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1786401008.299866:0:14223:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1786401008.299872:0:14223:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1786401008.301865:0:14223:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1786401008.301877:0:14223:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1786401008.304536:0:14223:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1786401008.304868:0:14223:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1786401008.304875:0:14223:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1786401008.307031:0:14223:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1786401008.307043:0:14223:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1786401008.308840:0:14223:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1786401008.308851:0:14223:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1786401008.311619:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401008.311625:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401008.311628:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401008.320328:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401008.320335:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401008.320338:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786401008.322194:0:14223:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1786401008.328827:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1786401008.345170:0:14223:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1786401008.345192:0:14223:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1786401008.345195:0:14223:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1786401008.348717:0:14232:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1786401008.349000:0:14223:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1786401008.349472:0:14223:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1786401008.350216:0:14223:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1786401008.353519:0:14223:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1786401008.353711:0:14223:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1786401008.353718:0:14223:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1786401008.357537:0:14223:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1786401008.357552:0:14223:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1786401008.363251:0:14223:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1786401008.363272:0:14223:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1786401008.366080:0:14223:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1786401008.366144:0:14223:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.108@tcp' 00000020:01000004:2.0:1786401008.366146:0:14223:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1786401008.366176:0:14223:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.108@tcp (typ=mgc) 00000020:00000080:2.0:1786401008.366189:0:14223:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.108@tcp (ffff9d6fe90399c0) 00000020:00000080:2.0:1786401008.366206:0:14223:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1786401008.366290:0:14223:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d6fc329a800@MGC192.168.204.108@tcp: add connection 192.168.204.108@tcp at head 00010000:00010000:2.0:1786401008.366651:0:14223:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.108@tcp-0 is initialized 00000040:01000000:2.0:1786401008.366660:0:14223:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.108@tcp ctxt 1 is initialized 10000000:01000000:2.0:1786401008.368827:0:14238:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1786401008.368882:0:14223:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.108@tcp (uuid 054a13af-ec40-49d6-93c2-21045d196afe) 00000020:00000080:2.0:1786401008.368904:0:14223:0:(genops.c:1406:class_connect()) connect: client 054a13af-ec40-49d6-93c2-21045d196afe, cookie 0x5ccaaf4f3cb1e8bb 00000100:00080000:2.0:1786401008.368916:0:14223:0:(import.c:510:import_select_connection()) MGC192.168.204.108@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1786401008.368922:0:14223:0:(import.c:624:import_select_connection()) MGC192.168.204.108@tcp: import ffff9d6fc329a800 using connection 192.168.204.108@tcp/0@lo 00000100:00100000:2.0:1786401008.368955:0:14223:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ffde23100 x1873176872174848/t0(0) o250->MGC192.168.204.108@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1786401008.368975:0:14223:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 054a13af-ec40-49d6-93c2-21045d196afe->MGS 00000020:01000004:2.0:1786401008.368992:0:14223:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1786401008.368997:0:14223:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1786401008.369011:0:14223:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9d6fe903cd40) 00000020:00000080:2.0:1786401008.369022:0:14223:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1786401008.370603:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:054a13af-ec40-49d6-93c2-21045d196afe:3305:1873176872174848:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1786401008.370764:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401008.370950:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872174848 00000100:00100000:1.0:1786401008.370958:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872174848 00000100:00100000:1.0:1786401008.370989:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786401008.370996:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec4c04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3305:x1873176872174848:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1786401008.371022:0:14233:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 054a13af-ec40-49d6-93c2-21045d196afe@0@lo t0 exp 0000000000000000 cur 460 last 0 00000020:00000080:1.0:1786401008.371058:0:14233:0:(genops.c:1406:class_connect()) connect: client 054a13af-ec40-49d6-93c2-21045d196afe, cookie 0x5ccaaf4f3cb1e8c9 00000100:00080000:1.0:1786401008.371607:0:14233:0:(import.c:65:import_set_state_nolock()) ffff9d6fc60f1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1786401008.372527:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec4c04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+5:3305:x1873176872174848:12345-0@lo:250:mount.lustre.0 Request processed in 1524us (1758us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401008.372540:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786401008.372607:0:3305:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.108@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1786401008.372617:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.108@tcp: connect to target with instance 0 00000100:00080000:1.0:1786401008.372626:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.108@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1786401008.372631:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1786401008.372634:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9d6fc329a800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1786401008.372649:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1786401008.372653:0:3305:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1786401008.372658:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:054a13af-ec40-49d6-93c2-21045d196afe:3305:1873176872174848:0@lo:250:mount.lustre.0 00000100:00080000:1.0:1786401008.387608:0:14237:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:2.0:1786401008.403872:0:14223:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786401008.404072:0:14223:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1786401008.404079:0:14223:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1786401008.411585:0:14223:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1786401008.411602:0:14223:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1786401008.412960:0:14223:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1786401008.412972:0:14223:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1786401008.416467:0:14223:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1786401008.416676:0:14223:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1786401008.416683:0:14223:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1786401008.420489:0:14223:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1786401008.420505:0:14223:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1786401008.500474:0:14223:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786401008.501916:0:14223:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1786401008.501926:0:14223:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1786401008.505106:0:14223:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1786401008.505123:0:14223:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1786401008.506174:0:14223:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1786401008.506354:0:14223:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1786401008.506359:0:14223:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1786401008.508720:0:14223:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1786401008.508759:0:14223:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1786401008.510952:0:14223:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1786401008.511706:0:14223:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1786401008.511715:0:14223:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1786401008.513419:0:14223:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1786401008.513430:0:14223:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1786401008.514976:0:14223:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1786401008.515780:0:14223:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1786401008.515787:0:14223:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1786401008.517801:0:14223:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1786401008.517814:0:14223:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1786401008.565840:0:14223:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786401008.566029:0:14223:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1786401008.566036:0:14223:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1786401008.569776:0:14223:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1786401008.569792:0:14223:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1786401008.572218:0:14223:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1786401008.572235:0:14223:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1786401008.580909:0:14223:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1786401008.580942:0:14223:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1786401008.580949:0:14223:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.108@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1786401008.581075:0:14223:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.108@tcp ctxt 0 is initialized 00000020:01000004:1.0:1786401008.581503:0:14223:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.108@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1786401008.581507:0:14223:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1786401008.581509:0:14223:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1786401008.581510:0:14223:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786401008.581511:0:14223:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786401008.581513:0:14223:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786401008.581514:0:14223:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786401008.581516:0:14223:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1786401008.581517:0:14223:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1786401008.581519:0:14223:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786401008.581520:0:14223:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1786401008.581523:0:14223:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1786401008.581525:0:14223:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1786401008.581526:0:14223:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1786401008.581527:0:14223:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786401008.581528:0:14223:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786401008.581530:0:14223:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786401008.581531:0:14223:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786401008.581532:0:14223:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1786401008.581533:0:14223:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1786401008.581534:0:14223:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786401008.581535:0:14223:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1786401008.581575:0:14223:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1786401008.581597:0:14223:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14223:1873176872174976:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1786401008.581939:0:14223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401008.582162:0:14223:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc3c80900 going to sleep for 11 seconds 00000100:00100000:0.0:1786401008.582574:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872174976 00000100:00100000:0.0:1786401008.582583:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872174976 00000100:00100000:0.0:1786401008.582754:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1786401008.582765:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef69b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+5:14223:x1873176872174976:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1786401008.582830:0:14236:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1786401008.582833:0:14236:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1786401008.582836:0:14236:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1786401008.583722:0:14257:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1786401008.584848:0:14236:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1786401008.593044:0:14258:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1786401008.593054:0:14258:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1786401008.593057:0:14258:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1786401008.593410:0:14258:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1786401008.594387:0:14236:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1786401008.594400:0:14236:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1786401008.609879:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef69b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+5:14223:x1873176872174976:12345-0@lo:253:mount.lustre.0 Request processed in 27106us (27931us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401008.609902:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786401008.610777:0:14223:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14223:1873176872174976:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1786401008.610797:0:14223:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1786401008.610801:0:14223:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1786401008.610803:0:14223:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1786401008.610804:0:14223:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786401008.610805:0:14223:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786401008.610806:0:14223:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786401008.610808:0:14223:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786401008.610809:0:14223:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1786401008.610811:0:14223:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1786401008.610813:0:14223:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786401008.610832:0:14223:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1786401008.610855:0:14223:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d6ec4cf8800 from lustre-MDT0000 10000000:01000000:1.0:1786401008.610883:0:14223:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1786401008.610887:0:14223:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1786401008.610892:0:14223:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9d6fe90399c0 10000000:01000000:1.0:1786401008.610897:0:14223:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1786401008.610906:0:14223:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9d6fe90399c0 from 1 10000000:01000000:1.0:1786401008.610909:0:14223:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1786401008.610954:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e400/0x5ccaaf4f3cb1e8d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401008.610965:0:14223:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e400/0x5ccaaf4f3cb1e8d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401008.610974:0:14223:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e400/0x5ccaaf4f3cb1e8d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786401008.610994:0:14223:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14223:1873176872175104:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1786401008.611041:0:14223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401008.611605:0:14223:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc3c80a80 going to sleep for 11 seconds 00000100:00100000:2.0:1786401008.611726:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872175104 00000100:00100000:2.0:1786401008.611734:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872175104 00000100:00100000:2.0:1786401008.611937:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1786401008.611947:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef699050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+5:14223:x1873176872175104:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786401008.611962:0:14235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786401008.611980:0:14235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e8d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1e8d0 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401008.612019:0:14235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e8d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1e8d0 expref: 6 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401008.612029:0:14235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fee1ba600/0x5ccaaf4f3cb1e8d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1e8d0 expref: 6 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401008.612039:0:14235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fee1ba600, rc 0) 00000100:00100000:2.0:1786401008.612129:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef699050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+6:14223:x1873176872175104:12345-0@lo:101:mount.lustre.0 Request processed in 183us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401008.612136:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786401008.612771:0:14223:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14223:1873176872175104:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786401008.612791:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e400/0x5ccaaf4f3cb1e8d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1e8d7 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401008.612801:0:14223:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e400/0x5ccaaf4f3cb1e8d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1e8d7 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786401008.612865:0:14223:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc99500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14223:1873176872175232:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786401008.612900:0:14223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401008.613786:0:14223:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff5f87780 going to sleep for 11 seconds 00000100:00100000:1.0:1786401008.614796:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872175232 00000100:00100000:1.0:1786401008.614808:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872175232 00000100:00100000:1.0:1786401008.614856:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1786401008.614865:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef69ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+6:14223:x1873176872175232:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786401008.615724:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef69ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+6:14223:x1873176872175232:12345-0@lo:501:mount.lustre.0 Request processed in 858us (2820us total) trans 0 rc -2/-2 00000100:00100000:1.0:1786401008.615734:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786401008.616214:0:14223:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc99500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14223:1873176872175232:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1786401008.616396:0:14223:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1786401008.616418:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e400/0x5ccaaf4f3cb1e8d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1e8d7 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401008.616443:0:14223:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e400/0x5ccaaf4f3cb1e8d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1e8d7 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786401008.616453:0:14223:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d6ec4cf8800 10000000:01000000:1.0:1786401008.616457:0:14223:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1786401008.616470:0:14223:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9d6ec4cf8800 10000000:01000000:1.0:1786401008.616473:0:14223:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1786401008.616476:0:14223:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9d6ec4cf8800 from 1 10000000:01000000:1.0:1786401008.616479:0:14223:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1786401008.616509:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138ec00/0x5ccaaf4f3cb1e8de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401008.616517:0:14223:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fc138ec00/0x5ccaaf4f3cb1e8de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401008.616527:0:14223:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fc138ec00/0x5ccaaf4f3cb1e8de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786401008.616544:0:14223:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14223:1873176872175360:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1786401008.616577:0:14223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401008.616609:0:14223:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc3c80a80 going to sleep for 11 seconds 00000100:00100000:2.0:1786401008.618192:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872175360 00000100:00100000:2.0:1786401008.618207:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872175360 00000100:00100000:2.0:1786401008.618286:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1786401008.618299:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef698050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+6:14223:x1873176872175360:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786401008.618317:0:14233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786401008.618337:0:14233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e8e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1e8de expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401008.618369:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e8e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1e8de expref: 7 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401008.618381:0:14233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fee1bbc00/0x5ccaaf4f3cb1e8e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1e8de expref: 7 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401008.618392:0:14233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fee1bbc00, rc 0) 00000100:00100000:2.0:1786401008.618474:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef698050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+7:14223:x1873176872175360:12345-0@lo:101:mount.lustre.0 Request processed in 163us (1881us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401008.618481:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1786401008.618810:0:14223:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14223:1873176872175360:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786401008.618828:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fc138ec00/0x5ccaaf4f3cb1e8de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1e8e5 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401008.618838:0:14223:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fc138ec00/0x5ccaaf4f3cb1e8de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1e8e5 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786401008.618868:0:14223:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1786401008.618873:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138ec00/0x5ccaaf4f3cb1e8de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1e8e5 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401008.618880:0:14223:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fc138ec00/0x5ccaaf4f3cb1e8de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1e8e5 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786401008.618888:0:14223:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1786401008.618893:0:14223:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1786401008.618899:0:14223:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9d6ec4cf8800 10000000:01000000:1.0:1786401008.618902:0:14223:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1786401008.618906:0:14223:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1786401008.618908:0:14223:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1786401008.618931:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e8ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401008.618938:0:14223:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e8ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401008.618946:0:14223:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e8ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786401008.618965:0:14223:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14223:1873176872175488:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1786401008.619000:0:14223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401008.619044:0:14223:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc3c80a80 going to sleep for 11 seconds 00000100:00100000:2.0:1786401008.619195:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872175488 00000100:00100000:2.0:1786401008.619200:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872175488 00000100:00100000:2.0:1786401008.619223:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1786401008.619229:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef69a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+7:14223:x1873176872175488:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786401008.619236:0:14233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786401008.619245:0:14233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e8f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1e8ec expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401008.619258:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e8f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1e8ec expref: 8 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401008.619266:0:14233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fee1ba800/0x5ccaaf4f3cb1e8f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1e8ec expref: 8 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401008.619272:0:14233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fee1ba800, rc 0) 00000100:00100000:2.0:1786401008.619299:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef69a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+8:14223:x1873176872175488:12345-0@lo:101:mount.lustre.0 Request processed in 69us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401008.619305:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1786401008.619566:0:14223:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14223:1873176872175488:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786401008.619577:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e8ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1e8f3 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401008.619592:0:14223:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e8ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1e8f3 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786401008.620148:0:14223:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14223:1873176872175616:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786401008.620189:0:14223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401008.620216:0:14223:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc3c80a80 going to sleep for 11 seconds 00000100:00100000:2.0:1786401008.620326:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872175616 00000100:00100000:2.0:1786401008.620332:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872175616 00000100:00100000:2.0:1786401008.620373:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1786401008.620381:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef699450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+8:14223:x1873176872175616:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786401008.621854:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef699450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+9:14223:x1873176872175616:12345-0@lo:501:mount.lustre.0 Request processed in 1469us (1659us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401008.621866:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1786401008.622237:0:14223:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14223:1873176872175616:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786401008.622290:0:14223:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14223:1873176872175744:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786401008.622339:0:14223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401008.622841:0:14223:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc3c80a80 going to sleep for 11 seconds 00000100:00100000:3.0:1786401008.623067:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872175744 00000100:00100000:3.0:1786401008.623074:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872175744 00000100:00100000:0.0:1786401008.623802:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1786401008.624226:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef699c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+9:14223:x1873176872175744:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1786401008.627017:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef699c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+9:14223:x1873176872175744:12345-0@lo:503:mount.lustre.0 Request processed in 3190us (4662us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401008.627053:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1786401008.627333:0:14223:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14223:1873176872175744:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786401008.627925:0:14259:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc99500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:054a13af-ec40-49d6-93c2-21045d196afe:14259:1873176872175872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786401008.627981:0:14259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401008.628334:0:14259:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff5f87300 going to sleep for 11 seconds 00000100:00100000:1.0:1786401008.628447:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872175872 00000100:00100000:1.0:1786401008.628455:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872175872 00000100:00100000:1.0:1786401008.628611:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1786401008.628621:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef69b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+9:14259:x1873176872175872:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786401008.629064:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef69b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+9:14259:x1873176872175872:12345-0@lo:502:llog_process_th.0 Request processed in 443us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401008.629072:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1786401008.630144:0:14259:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc99500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:054a13af-ec40-49d6-93c2-21045d196afe:14259:1873176872175872:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1786401008.630185:0:14259:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786401008.630199:0:14259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786401008.630201:0:14259:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1786401008.630207:0:14259:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1786401008.630210:0:14259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1786401008.630227:0:14259:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9d6fc33f0000) 00000020:00000080:0.0:1786401008.630246:0:14259:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1786401008.630252:0:14259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1786401008.630333:0:14259:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:0.0:1786401008.630341:0:14259:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5ccaaf4f3cb1e901 00000020:00000080:2.0:1786401008.631427:0:14259:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1786401008.631436:0:14259:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786401008.631442:0:14259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786401008.631444:0:14259:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1786401008.631449:0:14259:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786401008.631454:0:14259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786401008.631455:0:14259:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1786401008.632592:0:14259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1786401008.632616:0:14259:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9d6fe903b380) 00000020:00000080:2.0:1786401008.632722:0:14259:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1786401008.632736:0:14259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1786401008.632749:0:14259:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1786401008.632753:0:14259:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1786401008.632761:0:14259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1786401008.632860:0:14259:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d6ec4cf8800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1786401008.632880:0:14259:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9d6ffdb799c0) 00000020:00000080:2.0:1786401008.632890:0:14259:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1786401008.632939:0:14259:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1786401008.632947:0:14259:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5ccaaf4f3cb1e916 00000020:00000080:2.0:1786401008.633073:0:14259:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1786401008.633079:0:14259:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1786401008.633109:0:14259:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5ccaaf4f3cb1e91d 00080000:01000000:2.0:1786401008.633116:0:14259:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:2.0:1786401008.633121:0:14259:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5ccaaf4f3cb1e924 00010000:00010000:2.0:1786401008.710856:0:14259:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1786401008.711392:0:14259:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1786401008.711728:0:14259:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1786401008.712360:0:14259:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9d6ffdb78000) 00000020:00000080:2.0:1786401008.712380:0:14259:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1786401008.712471:0:14259:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1786401008.712487:0:14259:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5ccaaf4f3cb1e932 00000020:00000080:0.0:1786401008.722892:0:14259:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1786401008.734287:0:14259:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5ccaaf4f3cb1e939 00000020:00000080:3.0:1786401008.741947:0:14259:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1786401008.741962:0:14259:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786401008.741971:0:14259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786401008.741973:0:14259:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1786401008.741977:0:14259:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786401008.741983:0:14259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786401008.741985:0:14259:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1786401008.741989:0:14259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1786401008.742036:0:14259:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1786401008.742052:0:14259:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786401008.742056:0:14259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786401008.742057:0:14259:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1786401008.742060:0:14259:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1786401008.742062:0:14259:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1786401008.742063:0:14259:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1786401008.742064:0:14259:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1786401008.742066:0:14259:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1786401008.742068:0:14259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786401008.742069:0:14259:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1786401008.742072:0:14259:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1786401008.742075:0:14259:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1786401008.742077:0:14259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786401008.742079:0:14259:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1786401008.742081:0:14259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1786401008.742114:0:14259:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.108@tcp to nid 0x20000c0a8cc6c (192.168.204.108@tcp) 00000020:01000000:3.0:1786401008.742142:0:14259:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1786401008.742145:0:14259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1786401008.742161:0:14259:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9d6fc97b99c0) 00000020:00000080:3.0:1786401008.742177:0:14259:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1786401008.742181:0:14259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1786401008.742236:0:14259:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1786401008.742255:0:14259:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:3.0:1786401008.742261:0:14259:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5ccaaf4f3cb1e947 00010000:00080000:3.0:1786401008.742303:0:14259:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d6fc524a000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.108@tcp at head 00010000:00010000:3.0:1786401008.743954:0:14259:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1786401008.744397:0:14259:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1786401008.744449:0:14259:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1786401008.755362:0:14259:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1786401008.757846:0:14259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1786401008.757968:0:14259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1786401008.759271:0:14263:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1786401008.759278:0:14263:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1786401008.760963:0:14259:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1786401008.760981:0:14259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1786401008.761017:0:14259:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1786401008.761036:0:14259:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5ccaaf4f3cb1e94e 00000100:00080000:2.0:1786401008.761047:0:14259:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1786401008.761054:0:14259:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d6fc524a000 using connection 192.168.204.108@tcp/0@lo 00000100:00100000:2.0:1786401008.761799:0:14259:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ffde23100 x1873176872176000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786401008.761870:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873176872176000:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1786401008.761930:0:3305:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873176872176000 offset 0 length 520: 4 00000100:00080000:2.0:1786401008.762011:0:14259:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1786401008.762137:0:14259:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786401008.762142:0:14259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786401008.762144:0:14259:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1786401008.762146:0:14259:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1786401008.762149:0:14259:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1786401008.762150:0:14259:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1786401008.762152:0:14259:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1786401008.762153:0:14259:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1786401008.762156:0:14259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786401008.762157:0:14259:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1786401008.762160:0:14259:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1786401008.762164:0:14259:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1786401008.762167:0:14259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786401008.762169:0:14259:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1786401008.762172:0:14259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1786401008.762176:0:14259:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.108@tcp to nid 0x20000c0a8cc6c (192.168.204.108@tcp) 00000020:01000000:2.0:1786401008.762197:0:14259:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1786401008.762199:0:14259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1786401008.762213:0:14259:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9d6ffdb7cd40) 00000020:00000080:2.0:1786401008.762229:0:14259:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1786401008.762248:0:14259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1786401008.762315:0:14259:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1786401008.762321:0:14259:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:2.0:1786401008.762328:0:14259:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5ccaaf4f3cb1e95c 00010000:00080000:2.0:1786401008.762358:0:14259:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d70004f1800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.108@tcp at head 00010000:00010000:2.0:1786401008.763266:0:14259:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1786401008.763725:0:14259:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1786401008.763766:0:14259:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1786401008.766900:0:14259:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1786401008.767026:0:14259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1786401008.767284:0:14259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1786401008.767838:0:14265:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1786401008.767844:0:14265:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1786401008.768971:0:14259:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1786401008.768985:0:14259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1786401008.769019:0:14259:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1786401008.769039:0:14259:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5ccaaf4f3cb1e963 00000100:00080000:0.0:1786401008.769051:0:14259:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1786401008.769057:0:14259:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d70004f1800 using connection 192.168.204.108@tcp/0@lo 00000100:00100000:0.0:1786401008.769547:0:14259:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ffdc99500 x1873176872176128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786401008.769612:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873176872176128:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1786401008.769872:0:3305:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873176872176128 offset 0 length 520: 4 00000100:00080000:0.0:1786401008.769923:0:14259:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1786401008.770156:0:14259:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786401008.770161:0:14259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786401008.770163:0:14259:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1786401008.770166:0:14259:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786401008.770169:0:14259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786401008.770171:0:14259:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1786401008.770173:0:14259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1786401008.770175:0:14259:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1786401008.770183:0:14259:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786401008.770186:0:14259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786401008.770187:0:14259:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1786401008.770189:0:14259:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786401008.770191:0:14259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786401008.770193:0:14259:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1786401008.770196:0:14259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1786401008.770225:0:14259:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc99f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:054a13af-ec40-49d6-93c2-21045d196afe:14259:1873176872176256:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1786401008.770269:0:14259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401008.770291:0:14259:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc544a240 going to sleep for 11 seconds 00000100:00100000:3.0:1786401008.770369:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872176256 00000100:00100000:3.0:1786401008.770375:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872176256 00000100:00100000:3.0:1786401008.770422:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1786401008.770431:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef698850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+9:14259:x1873176872176256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786401008.771602:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef698850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+9:14259:x1873176872176256:12345-0@lo:502:llog_process_th.0 Request processed in 1166us (1326us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401008.771612:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1786401008.771903:0:14259:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc99f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:054a13af-ec40-49d6-93c2-21045d196afe:14259:1873176872176256:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1786401008.771933:0:14259:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786401008.771939:0:14259:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786401008.771941:0:14259:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1786401008.771946:0:14259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1786401008.772831:0:14223:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1786401008.772862:0:14223:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1786401008.772875:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e8ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1e8f3 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401008.772888:0:14223:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f800/0x5ccaaf4f3cb1e8ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1e8f3 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786401008.772896:0:14223:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9d6ec4cf8800 from 1 10000000:01000000:3.0:1786401008.772899:0:14223:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1786401008.772938:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fca090800/0x5ccaaf4f3cb1e96a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401008.772945:0:14223:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fca090800/0x5ccaaf4f3cb1e96a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401008.772970:0:14223:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fca090800/0x5ccaaf4f3cb1e96a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786401008.772991:0:14223:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd890a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14223:1873176872176384:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1786401008.773045:0:14223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786401008.773120:0:14223:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc4579c00 going to sleep for 11 seconds 00000100:00100000:2.0:1786401008.773582:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872176384 00000100:00100000:2.0:1786401008.773590:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872176384 00000100:00100000:2.0:1786401008.774183:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1786401008.774196:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef699850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+9:14223:x1873176872176384:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786401008.774213:0:14236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786401008.774232:0:14236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e971 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1e96a expref: -99 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401008.774258:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e971 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1e96a expref: 10 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401008.774268:0:14236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e971 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1e96a expref: 10 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401008.774277:0:14236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fee1bbe00, rc 0) 00000100:00100000:2.0:1786401008.774339:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef699850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+10:14223:x1873176872176384:12345-0@lo:101:mount.lustre.0 Request processed in 147us (1293us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401008.774346:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1786401008.774577:0:14223:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd890a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14223:1873176872176384:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786401008.774592:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fca090800/0x5ccaaf4f3cb1e96a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1e971 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401008.774600:0:14223:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fca090800/0x5ccaaf4f3cb1e96a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1e971 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786401008.780834:0:14223:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14223:1873176872176512:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1786401008.780918:0:14223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401008.781262:0:14223:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffde64cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786401008.781588:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872176512 00000100:00100000:0.0:1786401008.781597:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872176512 00000100:00100000:0.0:1786401008.782760:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1786401008.782779:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef69a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+10:14223:x1873176872176512:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1786401008.782816:0:14235:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1786401008.782823:0:14235:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1786401008.783166:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef69a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+10:14223:x1873176872176512:12345-0@lo:256:mount.lustre.0 Request processed in 395us (2247us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401008.783175:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1786401008.783289:0:14223:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14223:1873176872176512:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1786401008.785385:0:14223:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1786401008.785413:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fca090800/0x5ccaaf4f3cb1e96a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1e971 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401008.785427:0:14223:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fca090800/0x5ccaaf4f3cb1e96a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1e971 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786401008.785436:0:14223:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6ec4cf8800 from 1 10000000:01000000:1.0:1786401008.785439:0:14223:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1786401008.786013:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e978 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401008.786025:0:14223:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e978 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401008.786037:0:14223:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e978 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786401008.786077:0:14223:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14223:1873176872176640:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1786401008.786255:0:14223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401008.786290:0:14223:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffde64cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1786401008.786561:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872176640 00000100:00100000:3.0:1786401008.786569:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872176640 00000100:00100000:3.0:1786401008.787030:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1786401008.787043:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef698450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+10:14223:x1873176872176640:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786401008.787062:0:14233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786401008.787110:0:14233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fca090200/0x5ccaaf4f3cb1e97f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1e978 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401008.787136:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fca090200/0x5ccaaf4f3cb1e97f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1e978 expref: 11 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401008.787147:0:14233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fca090200/0x5ccaaf4f3cb1e97f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1e978 expref: 11 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401008.787156:0:14233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca090200, rc 0) 00000100:00100000:3.0:1786401008.787220:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef698450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+11:14223:x1873176872176640:12345-0@lo:101:mount.lustre.0 Request processed in 180us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401008.787227:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1786401008.787321:0:14223:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14223:1873176872176640:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786401008.787336:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e978 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1e97f expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401008.787344:0:14223:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e978 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1e97f expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786401008.787413:0:14223:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14223:1873176872176768:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786401008.787441:0:14223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401008.788059:0:14223:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffde64cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786401008.788759:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872176768 00000100:00100000:0.0:1786401008.788768:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872176768 00000100:00100000:0.0:1786401008.788810:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1786401008.788819:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef69bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+11:14223:x1873176872176768:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786401008.789722:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef69bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+11:14223:x1873176872176768:12345-0@lo:501:mount.lustre.0 Request processed in 901us (2276us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401008.789753:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1786401008.789933:0:14223:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14223:1873176872176768:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786401008.789992:0:14223:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14223:1873176872176896:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786401008.790038:0:14223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401008.790074:0:14223:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffde64cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786401008.790190:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872176896 00000100:00100000:0.0:1786401008.790195:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872176896 00000100:00100000:0.0:1786401008.790234:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1786401008.790242:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef69b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+11:14223:x1873176872176896:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786401008.790546:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef69b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+11:14223:x1873176872176896:12345-0@lo:503:mount.lustre.0 Request processed in 303us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401008.790554:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1786401008.790783:0:14223:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14223:1873176872176896:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1786401008.791240:0:14267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde20a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:054a13af-ec40-49d6-93c2-21045d196afe:14267:1873176872177024:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786401008.791288:0:14267:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786401008.791371:0:14267:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc343e780 going to sleep for 11 seconds 00000100:00100000:3.0:1786401008.791411:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872177024 00000100:00100000:3.0:1786401008.791417:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872177024 00000100:00100000:3.0:1786401008.791569:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1786401008.791579:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef69a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+11:14267:x1873176872177024:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786401008.792189:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef69a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+11:14267:x1873176872177024:12345-0@lo:502:llog_process_th.0 Request processed in 610us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401008.792200:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1786401008.792391:0:14267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde20a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:054a13af-ec40-49d6-93c2-21045d196afe:14267:1873176872177024:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1786401008.792420:0:14267:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786401008.792430:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786401008.792433:0:14267:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1786401008.792440:0:14267:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d6ec4cf8800 00000020:00000080:2.0:1786401008.792443:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1786401008.792452:0:14267:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786401008.792454:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786401008.792533:0:14267:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1786401008.792538:0:14267:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786401008.792542:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786401008.792543:0:14267:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1786401008.792547:0:14267:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d6ec4cf8800 00000020:00000080:2.0:1786401008.792549:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1786401008.792749:0:14267:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786401008.792754:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786401008.792755:0:14267:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1786401008.792757:0:14267:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786401008.792760:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786401008.792761:0:14267:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1786401008.792763:0:14267:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d6ec4cf8800 00000020:00000080:2.0:1786401008.792765:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1786401008.796438:0:14267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde20a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:054a13af-ec40-49d6-93c2-21045d196afe:14267:1873176872177152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786401008.796538:0:14267:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786401008.796588:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872177152 00000100:00100000:2.0:1786401008.796595:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872177152 00000100:00100000:2.0:1786401008.799956:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1786401008.799983:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef698c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+11:14267:x1873176872177152:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786401008.800283:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef698c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+11:14267:x1873176872177152:12345-0@lo:502:llog_process_th.0 Request processed in 314us (3744us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401008.800298:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1786401008.800366:0:14267:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff6ec9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1786401008.800391:0:14267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde20a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:054a13af-ec40-49d6-93c2-21045d196afe:14267:1873176872177152:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1786401008.800423:0:14267:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786401008.800432:0:14267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786401008.800434:0:14267:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1786401008.800440:0:14267:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1786401008.802593:0:14223:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1786401008.802712:0:14223:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1786401008.807867:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e978 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1e97f expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401008.807888:0:14223:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e978 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1e97f expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786401008.807961:0:14223:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1786401008.807964:0:14223:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d6ec4cf8800 10000000:01000000:2.0:1786401008.807968:0:14223:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d6ec4cf8800 10000000:01000000:2.0:1786401008.807972:0:14223:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1786401008.807979:0:14223:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d6ec4cf8800 from 1 10000000:01000000:2.0:1786401008.807982:0:14223:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1786401008.808022:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fee1bb800/0x5ccaaf4f3cb1e986 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401008.808031:0:14223:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fee1bb800/0x5ccaaf4f3cb1e986 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401008.808058:0:14223:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fee1bb800/0x5ccaaf4f3cb1e986 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786401008.808100:0:14223:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14223:1873176872177280:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1786401008.808173:0:14223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786401008.808222:0:14223:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff6ec9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1786401008.808341:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872177280 00000100:00100000:1.0:1786401008.808350:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872177280 00000100:00100000:1.0:1786401008.808408:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1786401008.808418:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9784050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+11:14223:x1873176872177280:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786401008.808432:0:14233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786401008.808447:0:14233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e98d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1e986 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401008.808582:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e98d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1e986 expref: 12 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401008.808593:0:14233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fc138f200/0x5ccaaf4f3cb1e98d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1e986 expref: 12 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401008.808602:0:14233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138f200, rc 0) 00000100:00100000:1.0:1786401008.808752:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9784050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+12:14223:x1873176872177280:12345-0@lo:101:mount.lustre.0 Request processed in 321us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401008.808760:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1786401008.808847:0:14223:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14223:1873176872177280:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786401008.808864:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fee1bb800/0x5ccaaf4f3cb1e986 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1e98d expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401008.808873:0:14223:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fee1bb800/0x5ccaaf4f3cb1e986 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1e98d expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786401008.808927:0:14223:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14223:1873176872177408:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786401008.808957:0:14223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786401008.808995:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872177408 00000100:00100000:2.0:1786401008.808999:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872177408 00000100:00100000:2.0:1786401008.809024:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1786401008.809030:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9786050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+12:14223:x1873176872177408:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786401008.809622:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9786050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+12:14223:x1873176872177408:12345-0@lo:501:mount.lustre.0 Request processed in 590us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401008.809775:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1786401008.809823:0:14223:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff6ec9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1786401008.809839:0:14223:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14223:1873176872177408:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786401008.809873:0:14223:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14223:1873176872177536:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1786401008.809915:0:14223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786401008.809933:0:14223:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff6ec9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1786401008.813601:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872177536 00000100:00100000:1.0:1786401008.813617:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872177536 00000100:00100000:1.0:1786401008.813773:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1786401008.813785:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9785450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+12:14223:x1873176872177536:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786401008.814025:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9785450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+12:14223:x1873176872177536:12345-0@lo:503:mount.lustre.0 Request processed in 242us (4108us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401008.814034:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1786401008.814136:0:14223:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14223:1873176872177536:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786401008.814991:0:14270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd892a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:054a13af-ec40-49d6-93c2-21045d196afe:14270:1873176872177664:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1786401008.815061:0:14270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786401008.815185:0:14270:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fcbb7c840 going to sleep for 11 seconds 00000100:00100000:1.0:1786401008.825840:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872177664 00000100:00100000:1.0:1786401008.825857:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872177664 00000100:00100000:1.0:1786401008.825915:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1786401008.825926:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9785c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+12:14270:x1873176872177664:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1786401008.826296:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9785c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+12:14270:x1873176872177664:12345-0@lo:502:llog_process_th.0 Request processed in 370us (11234us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401008.826305:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1786401008.826930:0:14270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd892a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:054a13af-ec40-49d6-93c2-21045d196afe:14270:1873176872177664:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1786401008.826998:0:14270:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1786401008.827014:0:14270:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9d6ffdb7b380) 00000020:00000080:2.0:1786401008.827035:0:14270:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1786401008.827222:0:14270:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d6ec4cf8800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1786401008.827227:0:14270:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d6ec4cf8800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1786401008.827229:0:14270:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d6ec4cf8800 4 00010000:00080000:2.0:1786401008.827260:0:14270:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d6fc5246000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.108@tcp at head 00010000:00010000:2.0:1786401008.838577:0:14270:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1786401008.840011:0:14270:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1786401008.840066:0:14270:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1786401008.840082:0:14270:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5ccaaf4f3cb1e99b 00000100:00080000:2.0:1786401008.840108:0:14270:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1786401008.840115:0:14270:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9d6fc5246000 using connection 192.168.204.108@tcp/0@lo 00000100:00100000:2.0:1786401008.840153:0:14270:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ffde22a00 x1873176872177792/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1786401008.842583:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873176872177792:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1786401008.842775:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1786401008.842856:0:14270:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1786401008.843845:0:14241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872177792 00000100:00100000:0.0:1786401008.843859:0:14241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872177792 00000100:00100000:0.0:1786401008.843899:0:14241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1786401008.843909:0:14241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1873176872177792:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1786401008.843995:0:14241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1873176872177792:12345-0@lo:38:llog_process_th.0 Request processed in 86us (1221us total) trans 0 rc -11/-11 00000100:00100000:0.0:1786401008.844003:0:14241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786401008.847684:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1786401008.847700:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9d6fc5246000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786401008.847709:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1786401008.847713:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873176872177792:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1786401008.847965:0:14270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde22a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:054a13af-ec40-49d6-93c2-21045d196afe:14270:1873176872177920:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786401008.848049:0:14270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786401008.848125:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872177920 00000100:00100000:2.0:1786401008.848131:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872177920 00000100:00100000:2.0:1786401008.848170:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1786401008.848178:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9787050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+12:14270:x1873176872177920:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1786401008.848413:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9787050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+12:14270:x1873176872177920:12345-0@lo:502:llog_process_th.0 Request processed in 234us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401008.848421:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1786401008.848506:0:14270:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff6ec9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1786401008.848522:0:14270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde22a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:054a13af-ec40-49d6-93c2-21045d196afe:14270:1873176872177920:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1786401008.848547:0:14270:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1786401008.848923:0:14223:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1786401008.848947:0:14223:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1786401008.848965:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fee1bb800/0x5ccaaf4f3cb1e986 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1e98d expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401008.848977:0:14223:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fee1bb800/0x5ccaaf4f3cb1e986 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1e98d expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1786401008.849024:0:14223:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1786401008.849027:0:14223:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1786401008.849028:0:14223:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786401008.849030:0:14223:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786401008.849031:0:14223:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786401008.849032:0:14223:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786401008.849034:0:14223:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1786401008.849035:0:14223:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1786401008.849037:0:14223:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786401008.849039:0:14223:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1786401008.849043:0:14223:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1786401008.849046:0:14223:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1786401008.849047:0:14223:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1786401008.849048:0:14223:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1786401008.849049:0:14223:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1786401008.849050:0:14223:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1786401008.849051:0:14223:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1786401008.849053:0:14223:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1786401008.849054:0:14223:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1786401008.849061:0:14223:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1786401008.849062:0:14223:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1786401008.849078:0:14223:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1786401008.849090:0:14223:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd890700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14223:1873176872178048:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1786401008.849148:0:14223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786401008.849173:0:14223:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fcbb7c240 going to sleep for 11 seconds 00000100:00100000:3.0:1786401008.849194:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872178048 00000100:00100000:3.0:1786401008.849199:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872178048 00000100:00100000:3.0:1786401008.849229:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1786401008.849235:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+12:14223:x1873176872178048:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1786401008.849269:0:14233:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1786401008.849285:0:14233:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1786401008.899377:0:14233:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1786401008.899392:0:14233:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1786401008.899436:0:14257:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1786401008.899441:0:14257:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1786401008.899474:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d6fca091800/0x5ccaaf4f3cb1e9a2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401008.899493:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e971 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1e96a expref: 12 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401008.899501:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d6fca091800/0x5ccaaf4f3cb1e9a2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401008.899541:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e971 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5ccaaf4f3cb1e96a expref: 12 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401008.899556:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e971 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1e96a expref: 12 pid: 14236 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786401008.899572:0:14257:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd892680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14257:1873176872178176:0@lo:104: 00000100:00100000:3.0:1786401008.899838:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786401008.899878:0:14257:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fcbb7c900 going to sleep for 11 seconds 00000100:00100000:3.0:1786401008.899912:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872178176 00000100:00100000:3.0:1786401008.899917:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872178176 00000100:00100000:3.0:1786401008.899953:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786401008.899961:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd891f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:054a13af-ec40-49d6-93c2-21045d196afe+3:14257:x1873176872178176:12345-0@lo:104: 00010000:00010000:3.0:1786401008.899973:0:14224:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.108@tcp lock: ffff9d6fca090800/0x5ccaaf4f3cb1e96a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1e971 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401008.900014:0:14224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786401008.900020:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd891f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:054a13af-ec40-49d6-93c2-21045d196afe+3:14257:x1873176872178176:12345-0@lo:104: Request processed in 59us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401008.900027:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786401008.900269:0:14257:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd892680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14257:1873176872178176:0@lo:104: 00010000:00010000:3.0:1786401008.900287:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d6fca091800/0x5ccaaf4f3cb1e9a2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401008.900447:0:14230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786401008.900454:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fca090800/0x5ccaaf4f3cb1e96a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1e971 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401008.900462:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca090800 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:2.0:1786401008.900465:0:14230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fca090800/0x5ccaaf4f3cb1e96a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5ccaaf4f3cb1e971 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401008.900473:0:14230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fca090800/0x5ccaaf4f3cb1e96a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5ccaaf4f3cb1e971 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786401008.900480:0:14230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fca090800/0x5ccaaf4f3cb1e96a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5ccaaf4f3cb1e971 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786401008.900486:0:14230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1786401008.900525:0:14230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6fca090800/0x5ccaaf4f3cb1e96a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1e971 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401008.900543:0:14230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786401008.900576:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fca090800/0x5ccaaf4f3cb1e96a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1e971 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401008.900584:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fca090800/0x5ccaaf4f3cb1e96a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1e971 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401008.900599:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401008.900601:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401008.900603:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786401008.900623:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786401008.900646:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:054a13af-ec40-49d6-93c2-21045d196afe:3308:1873176872178304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1786401008.900679:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786401008.900722:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872178304 00000100:00100000:2.0:1786401008.900727:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872178304 00010000:00010000:2.0:1786401008.900759:0:14226:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e971 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1e96a expref: 13 pid: 14236 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786401008.900781:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786401008.900791:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:054a13af-ec40-49d6-93c2-21045d196afe+13:3308:x1873176872178304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786401008.900802:0:14226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786401008.900807:0:14226:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e971 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1e96a expref: 13 pid: 14236 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401008.900816:0:14226:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e971 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1e96a expref: 13 pid: 14236 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401008.900828:0:14226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e971 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1e96a expref: 13 pid: 14236 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401008.900847:0:14226:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d6fca091800/0x5ccaaf4f3cb1e9a2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401008.900854:0:14226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fca091800/0x5ccaaf4f3cb1e9a2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1786401008.900867:0:14226:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001427660s 00010000:00010000:2.0:1786401008.900872:0:14226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fca091800/0x5ccaaf4f3cb1e9a2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401008.900878:0:14226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fca091800/0x5ccaaf4f3cb1e9a2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401008.900884:0:14226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d6fca091800/0x5ccaaf4f3cb1e9a2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401008.900890:0:14226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d6fca091800/0x5ccaaf4f3cb1e9a2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401008.900895:0:14226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca091800 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:2.0:1786401008.900899:0:14226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d6fca091800/0x5ccaaf4f3cb1e9a2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401008.900905:0:14226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d6fca091800/0x5ccaaf4f3cb1e9a2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401008.900917:0:14226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d6fca091800/0x5ccaaf4f3cb1e9a2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401008.900927:0:14226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786401008.900962:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:054a13af-ec40-49d6-93c2-21045d196afe+12:3308:x1873176872178304:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401008.900969:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786401008.900999:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:054a13af-ec40-49d6-93c2-21045d196afe:3308:1873176872178304:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786401008.901016:0:14257:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d6fca091800/0x5ccaaf4f3cb1e9a2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401008.901024:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d6fca091800/0x5ccaaf4f3cb1e9a2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401008.901029:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fca091800/0x5ccaaf4f3cb1e9a2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786401008.912998:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+11:14223:x1873176872178048:12345-0@lo:253:mount.lustre.0 Request processed in 63752us (63839us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401008.913016:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1786401008.913205:0:14223:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd890700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14223:1873176872178048:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1786401008.913220:0:14223:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1786401008.913223:0:14223:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1786401008.913225:0:14223:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1786401008.913226:0:14223:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786401008.913228:0:14223:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786401008.913229:0:14223:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786401008.913230:0:14223:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786401008.913231:0:14223:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1786401008.913233:0:14223:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1786401008.913235:0:14223:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786401008.913236:0:14223:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1786401008.913252:0:14223:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1786401008.919858:0:14223:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1786401008.920034:0:14223:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1786401008.920354:0:14223:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1786401008.920920:0:14223:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1786401008.922144:0:14223:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1786401008.922336:0:14223:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1786401008.924382:0:14223:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1786401008.924895:0:14223:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1786401008.925813:0:14223:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1786401008.926066:0:14223:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1786401008.927007:0:14223:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1786401008.927919:0:14223:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1786401008.971524:0:14223:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1786401008.972277:0:14223:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1786401008.972510:0:14279:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1786401008.972515:0:14279:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1786401008.972631:0:14280:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1786401008.972707:0:14280:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1786401008.975755:0:14280:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1786401008.975839:0:14280:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1786401008.975844:0:14280:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1786401008.978858:0:14223:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1786401008.979054:0:14223:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1786401008.979677:0:14223:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1786401008.979687:0:14223:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1786401008.979834:0:14223:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1786401008.981929:0:14223:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1786401008.982723:0:14223:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1786401008.982778:0:14223:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1786401008.985402:0:14223:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1786401008.992760:0:14223:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1786401009.033812:0:14223:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1786401009.033852:0:14223:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbdcdc1cd3988 00100000:10000000:0.0:1786401009.033861:0:14223:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1786401009.034657:0:14223:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1786401009.034677:0:14223:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.108@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1786401009.034693:0:14223:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1786401009.034721:0:14223:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1786401009.326630:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1786401009.519354:0:14238:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1786401009.519363:0:14238:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9d6ec4cf8800 from 6 10000000:01000000:3.0:1786401009.519369:0:14238:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1786401009.519421:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e9a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401009.519453:0:14238:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e9a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401009.519464:0:14238:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e9a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786401009.519554:0:14238:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd892680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:054a13af-ec40-49d6-93c2-21045d196afe:14238:1873176872178432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786401009.519626:0:14238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786401009.519674:0:14238:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc544a780 going to sleep for 11 seconds 00000100:00100000:0.0:1786401009.520691:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872178432 00000100:00100000:0.0:1786401009.520701:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872178432 00000100:00100000:0.0:1786401009.520763:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1786401009.520773:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9785850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+11:14238:x1873176872178432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786401009.520788:0:14235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786401009.520809:0:14235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e9b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1e9a9 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401009.520831:0:14235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e9b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1e9a9 expref: 12 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401009.520842:0:14235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e9b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1e9a9 expref: 12 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401009.520850:0:14235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5aa200, rc 0) 00000100:00100000:0.0:1786401009.522152:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9785850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+12:14238:x1873176872178432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1374us (2520us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401009.522163:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1786401009.522242:0:14238:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd892680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:054a13af-ec40-49d6-93c2-21045d196afe:14238:1873176872178432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786401009.522264:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e9a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1e9b0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401009.522275:0:14238:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e9a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1e9b0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786401009.522352:0:14238:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:054a13af-ec40-49d6-93c2-21045d196afe:14238:1873176872178560:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1786401009.522399:0:14238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401009.522436:0:14238:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc56c0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1786401009.522456:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872178560 00000100:00100000:0.0:1786401009.522462:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872178560 00000100:00100000:0.0:1786401009.523710:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1786401009.523740:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+12:14238:x1873176872178560:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1786401009.523767:0:14233:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1786401009.523787:0:14233:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1786401009.523790:0:14233:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1786401009.525307:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+12:14238:x1873176872178560:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1578us (2898us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401009.525322:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1786401009.526202:0:14238:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:054a13af-ec40-49d6-93c2-21045d196afe:14238:1873176872178560:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1786401009.526273:0:14238:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1786401009.526284:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e9a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1e9b0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401009.526295:0:14238:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e9a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1e9b0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786401009.904322:0:14275:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1786401010.352970:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1786401010.928381:0:14275:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1786401011.384787:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401012.399744:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401013.422820:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1786401013.998331:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1786401013.998339:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1786401013.998341:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1786401013.998345:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1786401013.998347:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1786401013.998350:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1786401013.998466:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:054a13af-ec40-49d6-93c2-21045d196afe:3306:1873176872178688:0@lo:400:kworker.0 00000100:00100000:3.0:1786401013.998536:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1786401013.998625:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d6fc5246000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1786401013.998646:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9d6fc5246000 using connection 192.168.204.108@tcp/0@lo 00000100:00100000:2.0:1786401013.998670:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ffde21f80 x1873176872178816/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1786401013.998746:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873176872178816:0@lo:38:kworker.0 00000100:00100000:3.0:1786401013.998783:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786401013.998869:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872178816 00000100:00100000:2.0:1786401013.998877:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872178816 00000100:00100000:2.0:1786401013.998918:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786401013.998925:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd893b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1873176872178816:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1786401013.998950:0:14243:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 466 last 0 00000020:00000080:2.0:1786401013.998992:0:14243:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5ccaaf4f3cb1e9b7 00000004:00100000:2.0:1786401013.999008:0:14243:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1786401013.999224:0:14243:0:(import.c:65:import_set_state_nolock()) ffff9d6fc5244000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786401013.999274:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd893b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1873176872178816:12345-0@lo:38:kworker.0 Request processed in 348us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401013.999282:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1786401013.999505:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d6ffde21f80 x1873176872178816/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786401023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1786401013.999519:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1786401013.999527:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1786401013.999533:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1786401013.999535:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9d6fc5246000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1786401013.999541:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1873176872178816:0@lo:38:kworker.0 00000100:00100000:0.0:1786401013.999684:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872178688 00000100:00100000:0.0:1786401013.999690:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872178688 00000100:00100000:0.0:1786401013.999736:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1786401013.999744:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9784450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+12:3306:x1873176872178688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786401013.999789:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9784450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+12:3306:x1873176872178688:12345-0@lo:400:kworker.0 Request processed in 45us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401013.999795:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1786401013.999832:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:054a13af-ec40-49d6-93c2-21045d196afe:3306:1873176872178688:0@lo:400:kworker.0 00010000:00010000:2.0:1786401014.448836:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1786401014.692070:0:14524:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg408-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1786401015.471719:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401016.496238:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401017.519026:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1786401018.006428:0:14675:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffc91137fb0 00000020:00000080:1.0:1786401018.006454:0:14675:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1786401018.006460:0:14675:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1786401018.006471:0:14675:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc9113a240 20000000:00000080:1.0:1786401018.006480:0:14675:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d6fc58cd800 uarg=0000000000000000 20000000:01000000:1.0:1786401018.006528:0:14675:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1786401018.006537:0:14675:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1786401018.006544:0:14675:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1786401018.010832:0:14676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1786401018.011267:0:14675:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1786401018.019859:0:14675:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1786401018.020020:0:14675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d6fee1bb000/0x5ccaaf4f3cb1e9be lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401018.020046:0:14675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fca090200/0x5ccaaf4f3cb1e97f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1e978 expref: 11 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401018.020057:0:14675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d6fee1bb000/0x5ccaaf4f3cb1e9be lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401018.020459:0:14675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fca090200/0x5ccaaf4f3cb1e97f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5ccaaf4f3cb1e978 expref: 11 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401018.020481:0:14675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d6fca090200/0x5ccaaf4f3cb1e97f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1e978 expref: 11 pid: 14233 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786401018.020501:0:14675:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde20380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14675:1873176872178944:0@lo:104: 00000100:00100000:2.0:1786401018.020600:0:14675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786401018.020715:0:14675:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffde64300 going to sleep for 11 seconds 00000100:00100000:3.0:1786401018.020787:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872178944 00000100:00100000:3.0:1786401018.020798:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872178944 00000100:00100000:3.0:1786401018.020876:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1786401018.020887:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:054a13af-ec40-49d6-93c2-21045d196afe+3:14675:x1873176872178944:12345-0@lo:104: 00010000:00010000:3.0:1786401018.020903:0:14225:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.108@tcp lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e978 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1e97f expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401018.021023:0:14225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1786401018.021030:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:054a13af-ec40-49d6-93c2-21045d196afe+3:14675:x1873176872178944:12345-0@lo:104: Request processed in 146us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401018.021038:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786401018.021138:0:14675:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde20380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14675:1873176872178944:0@lo:104: 00010000:00010000:2.0:1786401018.021242:0:14675:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d6fee1bb000/0x5ccaaf4f3cb1e9be lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401018.021589:0:14230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786401018.021601:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e978 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1e97f expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401018.021633:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138ee00 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:0.0:1786401018.021638:0:14230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e978 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5ccaaf4f3cb1e97f expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401018.021647:0:14230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e978 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5ccaaf4f3cb1e97f expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786401018.021654:0:14230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e978 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5ccaaf4f3cb1e97f expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786401018.021660:0:14230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1786401018.021724:0:14230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e978 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1e97f expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401018.021731:0:14230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786401018.021761:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e978 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1e97f expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401018.021768:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1e978 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1e97f expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401018.021795:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786401018.021799:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786401018.021802:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786401018.021810:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:054a13af-ec40-49d6-93c2-21045d196afe:3307:1873176872179072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1786401018.021857:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401018.022017:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872179072 00000100:00100000:0.0:1786401018.022023:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872179072 00010000:00010000:0.0:1786401018.022052:0:14226:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fca090200/0x5ccaaf4f3cb1e97f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1e978 expref: 12 pid: 14233 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786401018.022116:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1786401018.022136:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd890380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:054a13af-ec40-49d6-93c2-21045d196afe+12:3307:x1873176872179072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786401018.022286:0:14226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786401018.022294:0:14226:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fca090200/0x5ccaaf4f3cb1e97f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1e978 expref: 12 pid: 14233 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401018.022318:0:14226:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fca090200/0x5ccaaf4f3cb1e97f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1e978 expref: 12 pid: 14233 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401018.022336:0:14226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fca090200/0x5ccaaf4f3cb1e97f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1e978 expref: 12 pid: 14233 timeout: 570 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401018.022352:0:14226:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d6fee1bb000/0x5ccaaf4f3cb1e9be lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401018.022361:0:14226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fee1bb000/0x5ccaaf4f3cb1e9be lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401018.022378:0:14226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fee1bb000/0x5ccaaf4f3cb1e9be lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401018.022385:0:14226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fee1bb000/0x5ccaaf4f3cb1e9be lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401018.022392:0:14226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d6fee1bb000/0x5ccaaf4f3cb1e9be lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401018.022399:0:14226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d6fee1bb000/0x5ccaaf4f3cb1e9be lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401018.022406:0:14226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1bb000 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:0.0:1786401018.022411:0:14226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d6fee1bb000/0x5ccaaf4f3cb1e9be lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401018.022427:0:14226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d6fee1bb000/0x5ccaaf4f3cb1e9be lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401018.022451:0:14226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d6fee1bb000/0x5ccaaf4f3cb1e9be lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401018.022463:0:14226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786401018.022509:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd890380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:054a13af-ec40-49d6-93c2-21045d196afe+11:3307:x1873176872179072:12345-0@lo:103:ldlm_bl.0 Request processed in 373us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401018.022521:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1786401018.022583:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:054a13af-ec40-49d6-93c2-21045d196afe:3307:1873176872179072:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1786401018.022707:0:14675:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d6fee1bb000/0x5ccaaf4f3cb1e9be lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401018.022716:0:14675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d6fee1bb000/0x5ccaaf4f3cb1e9be lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401018.022723:0:14675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fee1bb000/0x5ccaaf4f3cb1e9be lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786401018.095265:0:3305:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786401008/real 1786401008] req@ffff9d6ffdc99500 x1873176872176128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786401018 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786401018.095310:0:3305:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d6ffdc99500 x1873176872176128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786401018 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786401018.095324:0:3305:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786401008/real 1786401008] req@ffff9d6ffde23100 x1873176872176000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786401018 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786401018.095336:0:3305:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d6ffde23100 x1873176872176000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786401018 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1786401018.095373:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9d70004f1800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786401018.095397:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1786401018.095401:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873176872176128:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1786401018.095407:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9d6fc524a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1786401018.095412:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1786401018.095415:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873176872176000:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1786401018.096139:0:12743:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1786401018.096355:0:12743:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1786401018.096359:0:12743:0:(import.c:65:import_set_state_nolock()) ffff9d6fc524a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786401018.096366:0:12743:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 461 00000100:00080000:0.0:1786401018.096373:0:12743:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1786401018.096382:0:12743:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d6fc524a000 using connection 192.168.204.108@tcp/0@lo 00000100:00100000:0.0:1786401018.096428:0:12743:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ffdc9aa00 x1873176872179200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786401018.096456:0:12743:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1786401018.096459:0:12743:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1786401018.096461:0:12743:0:(import.c:65:import_set_state_nolock()) ffff9d70004f1800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786401018.096464:0:12743:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 461 00000100:00080000:0.0:1786401018.096467:0:12743:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1786401018.096470:0:12743:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d70004f1800 using connection 192.168.204.108@tcp/0@lo 00000100:00100000:0.0:1786401018.096494:0:12743:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ffdc9ad80 x1873176872179328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786401018.096935:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873176872179456:0@lo:400:kworker.0 00000100:00100000:3.0:1786401018.097847:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873176872179200:0@lo:8:kworker.0 00000400:00000100:3.0:1786401018.097900:0:3305:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873176872179200 offset 0 length 520: 4 00000100:00100000:3.0:1786401018.097954:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873176872179328:0@lo:8:kworker.0 00000400:00000100:3.0:1786401018.097974:0:3305:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873176872179328 offset 0 length 520: 4 00000100:00100000:0.0:1786401018.105362:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401018.105511:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872179456 00000100:00100000:1.0:1786401018.105528:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872179456 00000100:00100000:1.0:1786401018.105610:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786401018.105624:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873176872179456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786401018.105737:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873176872179456:12345-0@lo:400:kworker.0 Request processed in 117us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401018.105745:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1786401018.109383:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d6ffdc98380 x1873176872179456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786401034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786401018.109404:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873176872179456:0@lo:400:kworker.0 00010000:00010000:2.0:1786401018.542351:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786401019.567724:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1786401019.825200:0:14238:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1786401019.825210:0:14238:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6ec4cf8800 from 10 10000000:01000000:2.0:1786401019.825338:0:14238:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1786401019.825396:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e9c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401019.825409:0:14238:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e9c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401019.825421:0:14238:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e9c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786401019.825449:0:14238:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde20380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:054a13af-ec40-49d6-93c2-21045d196afe:14238:1873176872179584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1786401019.825726:0:14238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786401019.825787:0:14238:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc4894e40 going to sleep for 11 seconds 00000100:00100000:1.0:1786401019.825853:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872179584 00000100:00100000:1.0:1786401019.825861:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872179584 00000100:00100000:1.0:1786401019.825921:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1786401019.825931:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9787c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+11:14238:x1873176872179584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786401019.825945:0:14233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786401019.825960:0:14233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e9cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1e9c5 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401019.825985:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e9cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1e9c5 expref: 12 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401019.825997:0:14233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e9cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1e9c5 expref: 12 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401019.826012:0:14233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138e600, rc 0) 00000100:00100000:1.0:1786401019.826059:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9787c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+12:14238:x1873176872179584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401019.826065:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1786401019.826146:0:14238:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde20380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:054a13af-ec40-49d6-93c2-21045d196afe:14238:1873176872179584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786401019.826160:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e9c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1e9cc expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401019.826169:0:14238:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e9c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1e9cc expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786401019.826362:0:14238:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:054a13af-ec40-49d6-93c2-21045d196afe:14238:1873176872179712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786401019.826392:0:14238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401019.826408:0:14238:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc58f9300 going to sleep for 11 seconds 00000100:00100000:1.0:1786401019.826422:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872179712 00000100:00100000:1.0:1786401019.826426:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872179712 00000100:00100000:1.0:1786401019.826451:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1786401019.826458:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9787850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+12:14238:x1873176872179712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786401019.826716:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9787850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+12:14238:x1873176872179712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 257us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401019.826723:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1786401019.826755:0:14238:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:054a13af-ec40-49d6-93c2-21045d196afe:14238:1873176872179712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786401019.826783:0:14238:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:054a13af-ec40-49d6-93c2-21045d196afe:14238:1873176872179840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786401019.826819:0:14238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401019.826838:0:14238:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc58f9300 going to sleep for 11 seconds 00000100:00100000:1.0:1786401019.826849:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872179840 00000100:00100000:1.0:1786401019.826852:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872179840 00000100:00100000:1.0:1786401019.826872:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1786401019.826879:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9786850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+12:14238:x1873176872179840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786401019.827013:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9786850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+12:14238:x1873176872179840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401019.827020:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1786401019.827059:0:14238:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:054a13af-ec40-49d6-93c2-21045d196afe:14238:1873176872179840:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1786401019.827936:0:14743:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1786401019.834037:0:14238:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1786401019.834078:0:14238:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1786401019.834111:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e9c5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1e9cc expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401019.834123:0:14238:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e9c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1e9cc expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786401020.145898:0:14275:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1786401020.591239:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786401021.618701:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1786401022.409312:0:14876:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1786401022.409316:0:14876:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1786401022.409427:0:14876:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9d6feddc7000 00000020:01000004:2.0:1786401022.409443:0:14876:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1786401022.409455:0:14876:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1786401022.409990:0:14876:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9d6fc4f2b380) 00000020:00000080:2.0:1786401022.410012:0:14876:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1786401022.426326:0:14876:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1786401022.426607:0:14876:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1786401022.427480:0:14876:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1786401022.427723:0:14876:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1786401022.428023:0:14876:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1786401022.428432:0:14876:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:3.0:1786401022.428628:0:14876:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:3.0:1786401022.428730:0:14876:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:3.0:1786401022.429498:0:14876:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 196: rc = 0 00100000:10000000:3.0:1786401022.430176:0:14876:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 196: rc = 0 00100000:10000000:3.0:1786401022.430453:0:14876:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 196: rc = 0 00100000:10000000:3.0:1786401022.430748:0:14876:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 196: rc = 0 00100000:10000000:3.0:1786401022.431134:0:14876:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 196: rc = 0 00100000:10000000:3.0:1786401022.431392:0:14876:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 196: rc = 0 00000020:00000080:3.0:1786401022.432056:0:14876:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1786401022.432068:0:14876:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1786401022.432078:0:14876:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5ccaaf4f3cb1e9da 00000020:01000004:3.0:1786401022.432108:0:14876:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1786401022.432129:0:14876:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.108@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1786401022.432133:0:14876:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.108@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1786401022.432139:0:14876:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1786401022.432144:0:14876:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1786401022.432155:0:14876:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9d6fc97bcd40) 00000020:00000080:3.0:1786401022.432166:0:14876:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1786401022.433365:0:14876:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1786401022.433521:0:14876:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1786401022.433528:0:14876:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1786401022.434163:0:14876:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1786401022.434170:0:14876:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1786401022.435767:0:14876:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1786401022.435777:0:14876:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1786401022.443857:0:14876:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1786401022.444019:0:14876:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1786401022.444025:0:14876:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1786401022.445543:0:14876:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1786401022.445554:0:14876:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1786401022.490718:0:14876:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1786401022.490961:0:14876:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1786401022.490969:0:14876:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1786401022.493633:0:14876:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1786401022.493649:0:14876:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1786401022.495030:0:14876:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1786401022.495042:0:14876:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1786401022.497949:0:14876:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1786401022.498329:0:14876:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1786401022.498335:0:14876:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1786401022.499018:0:14876:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1786401022.499026:0:14876:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1786401022.540241:0:14876:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1786401022.540428:0:14876:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1786401022.540435:0:14876:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1786401022.542654:0:14876:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1786401022.542670:0:14876:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1786401022.543915:0:14876:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1786401022.543944:0:14876:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1786401022.543950:0:14876:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.108@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1786401022.553915:0:14876:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.108@tcp ctxt 0 is initialized 00000020:01000004:2.0:1786401022.553968:0:14876:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.108@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1786401022.553973:0:14876:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1786401022.553975:0:14876:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1786401022.553977:0:14876:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786401022.553978:0:14876:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786401022.553979:0:14876:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786401022.553981:0:14876:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786401022.553982:0:14876:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1786401022.553990:0:14876:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786401022.553991:0:14876:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1786401022.553996:0:14876:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1786401022.553998:0:14876:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1786401022.553999:0:14876:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1786401022.554000:0:14876:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786401022.554001:0:14876:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786401022.554002:0:14876:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786401022.554003:0:14876:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786401022.554004:0:14876:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1786401022.554005:0:14876:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786401022.554006:0:14876:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1786401022.554033:0:14876:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1786401022.554054:0:14876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde23800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14876:1873176872179968:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1786401022.554166:0:14876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786401022.554271:0:14876:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffdbfb840 going to sleep for 11 seconds 00000100:00100000:1.0:1786401022.554503:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872179968 00000100:00100000:1.0:1786401022.554514:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872179968 00000100:00100000:1.0:1786401022.554620:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1786401022.554632:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9784c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+12:14876:x1873176872179968:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1786401022.554664:0:14236:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1786401022.554667:0:14236:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1786401022.554671:0:14236:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1786401022.562705:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9784c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+12:14876:x1873176872179968:12345-0@lo:253:mount.lustre.0 Request processed in 8067us (8530us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401022.562720:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1786401022.562827:0:14876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde23800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14876:1873176872179968:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1786401022.562843:0:14876:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1786401022.562846:0:14876:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1786401022.562848:0:14876:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1786401022.562849:0:14876:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1786401022.562851:0:14876:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1786401022.562852:0:14876:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1786401022.562854:0:14876:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1786401022.562855:0:14876:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1786401022.562857:0:14876:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1786401022.562859:0:14876:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1786401022.562896:0:14876:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d6feddc7000 from lustre-OST0000 10000000:01000000:2.0:1786401022.562923:0:14876:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1786401022.562926:0:14876:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1786401022.562933:0:14876:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d6fe90399c0 local copy 00010000:00010000:2.0:1786401022.562944:0:14876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e400/0x5ccaaf4f3cb1e8d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1e8d7 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786401022.563265:0:14876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde23800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14876:1873176872180096:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786401022.563310:0:14876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786401022.563480:0:14876:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffdbfbcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1786401022.563531:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872180096 00000100:00100000:0.0:1786401022.563537:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872180096 00000100:00100000:0.0:1786401022.563622:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1786401022.563631:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9787450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+12:14876:x1873176872180096:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786401022.563805:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9787450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+12:14876:x1873176872180096:12345-0@lo:501:mount.lustre.0 Request processed in 175us (494us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786401022.563813:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1786401022.563896:0:14876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde23800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14876:1873176872180096:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1786401022.563910:0:14876:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.108@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1786401022.564078:0:14876:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.108@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1786401022.564120:0:14876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e400/0x5ccaaf4f3cb1e8d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1e8d7 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401022.564132:0:14876:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e400/0x5ccaaf4f3cb1e8d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1e8d7 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786401022.564155:0:14876:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d6feddc7000 10000000:01000000:3.0:1786401022.564161:0:14876:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1786401022.564172:0:14876:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9d6fe90399c0 10000000:01000000:3.0:1786401022.564174:0:14876:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1786401022.564178:0:14876:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9d6fe90399c0 from 1 10000000:01000000:3.0:1786401022.564181:0:14876:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1786401022.564219:0:14876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fca090400/0x5ccaaf4f3cb1e9e8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401022.564227:0:14876:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fca090400/0x5ccaaf4f3cb1e9e8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401022.564236:0:14876:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fca090400/0x5ccaaf4f3cb1e9e8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786401022.564249:0:14876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd890e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14876:1873176872180224:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1786401022.564277:0:14876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786401022.564578:0:14876:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffccb7480 going to sleep for 11 seconds 00000100:00100000:2.0:1786401022.564661:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872180224 00000100:00100000:2.0:1786401022.564666:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872180224 00000100:00100000:2.0:1786401022.564693:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1786401022.564700:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9786c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+12:14876:x1873176872180224:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786401022.564710:0:14233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786401022.564723:0:14233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fee1bac00/0x5ccaaf4f3cb1e9ef lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1e9e8 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401022.564744:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fee1bac00/0x5ccaaf4f3cb1e9ef lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1e9e8 expref: 13 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401022.564754:0:14233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fee1bac00/0x5ccaaf4f3cb1e9ef lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1e9e8 expref: 13 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401022.564763:0:14233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fee1bac00, rc 0) 00000100:00100000:2.0:1786401022.564801:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9786c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+13:14876:x1873176872180224:12345-0@lo:101:mount.lustre.0 Request processed in 100us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401022.564807:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1786401022.564881:0:14876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd890e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14876:1873176872180224:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786401022.564894:0:14876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fca090400/0x5ccaaf4f3cb1e9e8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1e9ef expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401022.564903:0:14876:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fca090400/0x5ccaaf4f3cb1e9e8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1e9ef expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786401022.564920:0:14876:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1786401022.564937:0:14876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fca090400/0x5ccaaf4f3cb1e9e8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1e9ef expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401022.564945:0:14876:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fca090400/0x5ccaaf4f3cb1e9e8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1e9ef expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786401022.564965:0:14876:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1786401022.564969:0:14876:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1786401022.564973:0:14876:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1786401022.564976:0:14876:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1786401022.564992:0:14876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fca091a00/0x5ccaaf4f3cb1e9f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401022.565000:0:14876:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fca091a00/0x5ccaaf4f3cb1e9f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401022.565008:0:14876:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fca091a00/0x5ccaaf4f3cb1e9f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786401022.565019:0:14876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd890e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14876:1873176872180352:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1786401022.565044:0:14876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786401022.565056:0:14876:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffccb7480 going to sleep for 11 seconds 00000100:00100000:2.0:1786401022.565114:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872180352 00000100:00100000:2.0:1786401022.565117:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872180352 00000100:00100000:2.0:1786401022.565134:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1786401022.565139:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9785050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+13:14876:x1873176872180352:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786401022.565146:0:14233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786401022.565153:0:14233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fee1bb000/0x5ccaaf4f3cb1e9fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1e9f6 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401022.565165:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fee1bb000/0x5ccaaf4f3cb1e9fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1e9f6 expref: 14 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401022.565180:0:14233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fee1bb000/0x5ccaaf4f3cb1e9fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1e9f6 expref: 14 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401022.565199:0:14233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fee1bb000, rc 0) 00000100:00100000:2.0:1786401022.565232:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9785050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+14:14876:x1873176872180352:12345-0@lo:101:mount.lustre.0 Request processed in 93us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401022.565238:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1786401022.565352:0:14876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd890e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14876:1873176872180352:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786401022.565440:0:14876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fca091a00/0x5ccaaf4f3cb1e9f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1e9fd expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401022.565447:0:14876:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fca091a00/0x5ccaaf4f3cb1e9f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1e9fd expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786401022.566147:0:14876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1786401022.567287:0:14876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786401022.567644:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1786401022.567694:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1786401022.567727:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1786401022.567808:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1786401022.567844:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1786401022.567874:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1786401022.567939:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1786401022.567948:0:14876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1786401022.568027:0:14876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd890e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14876:1873176872180480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786401022.568131:0:14876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786401022.568172:0:14876:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffccb7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1786401022.568193:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872180480 00000100:00100000:0.0:1786401022.568200:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872180480 00000100:00100000:0.0:1786401022.568428:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1786401022.568439:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+14:14876:x1873176872180480:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786401022.568959:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+14:14876:x1873176872180480:12345-0@lo:501:mount.lustre.0 Request processed in 520us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401022.568967:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1786401022.569051:0:14876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd890e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14876:1873176872180480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786401022.569133:0:14876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd890e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14876:1873176872180608:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786401022.569175:0:14876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401022.569434:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872180608 00000100:00100000:1.0:1786401022.569439:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872180608 00000100:00100000:1.0:1786401022.569520:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1786401022.569529:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+14:14876:x1873176872180608:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786401022.569837:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+14:14876:x1873176872180608:12345-0@lo:503:mount.lustre.0 Request processed in 308us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401022.569844:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1786401022.570452:0:14876:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffccb7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1786401022.570490:0:14876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd890e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14876:1873176872180608:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1786401022.571082:0:14876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1786401022.571173:0:14876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd890e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14876:1873176872180736:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786401022.571339:0:14876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786401022.571451:0:14876:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffccb7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1786401022.572014:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872180736 00000100:00100000:0.0:1786401022.572023:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872180736 00000100:00100000:0.0:1786401022.572100:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1786401022.572110:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+14:14876:x1873176872180736:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786401022.572490:0:14876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd890e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14876:1873176872180736:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1786401022.572765:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1786401022.572819:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1786401022.572850:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1786401022.572895:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1786401022.572933:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000100:00100000:0.0:1786401022.572965:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+14:14876:x1873176872180736:12345-0@lo:502:mount.lustre.0 Request processed in 856us (1624us total) trans 0 rc 0/0 00000040:00080000:3.0:1786401022.572967:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000100:00100000:0.0:1786401022.572975:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000040:00080000:3.0:1786401022.573013:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1786401022.573049:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1786401022.573080:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1786401022.573181:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1786401022.574556:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1786401022.574622:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1786401022.574672:0:14876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd890e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14876:1873176872180864:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786401022.574741:0:14876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786401022.574894:0:14876:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffccb7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1786401022.574937:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872180864 00000100:00100000:1.0:1786401022.574945:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872180864 00000100:00100000:1.0:1786401022.575057:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1786401022.575067:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+14:14876:x1873176872180864:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786401022.575324:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+14:14876:x1873176872180864:12345-0@lo:502:mount.lustre.0 Request processed in 259us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401022.575332:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1786401022.575511:0:14876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd890e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14876:1873176872180864:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1786401022.575590:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1786401022.575599:0:14876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1786401022.577050:0:14890:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1786401022.577065:0:14890:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1786401022.577073:0:14890:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786401022.577076:0:14890:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1786401022.577083:0:14890:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1786401022.577177:0:14890:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9d6fc97b8000) 00000020:00000080:3.0:1786401022.577325:0:14890:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1786401022.577333:0:14890:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1786401022.577490:0:14890:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d6feddc7000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1786401022.577497:0:14890:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1786401022.577504:0:14890:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5ccaaf4f3cb1ea0b 00010000:00010000:3.0:1786401022.581831:0:14890:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1786401022.582609:0:14890:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1786401022.584633:0:14890:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1786401022.586030:0:14890:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1786401022.586041:0:14890:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786401022.586048:0:14890:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786401022.586050:0:14890:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1786401022.586054:0:14890:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1786401022.586056:0:14890:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1786401022.586058:0:14890:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1786401022.586059:0:14890:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1786401022.586061:0:14890:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1786401022.586063:0:14890:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786401022.586064:0:14890:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1786401022.586066:0:14890:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786401022.586069:0:14890:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786401022.586071:0:14890:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1786401022.586073:0:14890:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1786401022.586075:0:14890:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1786401022.586078:0:14890:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786401022.586117:0:14890:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786401022.586119:0:14890:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1786401022.586122:0:14890:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1786401022.586124:0:14890:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786401022.586126:0:14890:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1786401022.586129:0:14890:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1786401022.587300:0:14890:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1786401022.587308:0:14890:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1786401022.587310:0:14890:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1786401022.587315:0:14890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1786401022.590335:0:14876:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1786401022.590532:0:14876:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1786401022.590561:0:14876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fca091a00/0x5ccaaf4f3cb1e9f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1e9fd expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401022.590576:0:14876:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fca091a00/0x5ccaaf4f3cb1e9f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1e9fd expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786401022.590584:0:14876:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6feddc7000 from 1 10000000:01000000:1.0:1786401022.590587:0:14876:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1786401022.590626:0:14876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1ea12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401022.590634:0:14876:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1ea12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401022.590646:0:14876:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1ea12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786401022.590675:0:14876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14876:1873176872180992:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1786401022.590739:0:14876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401022.590795:0:14876:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc58f9600 going to sleep for 11 seconds 00000100:00100000:0.0:1786401022.591025:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872180992 00000100:00100000:0.0:1786401022.591034:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872180992 00000100:00100000:0.0:1786401022.591115:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1786401022.591123:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+14:14876:x1873176872180992:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786401022.591137:0:14233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786401022.591149:0:14233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1ea19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1ea12 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401022.591173:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1ea19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1ea12 expref: 15 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401022.591502:0:14233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1ea19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1ea12 expref: 15 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401022.591513:0:14233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5ab800, rc 0) 00000100:00100000:0.0:1786401022.591602:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+15:14876:x1873176872180992:12345-0@lo:101:mount.lustre.0 Request processed in 478us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401022.591619:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1786401022.598143:0:14876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14876:1873176872180992:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786401022.598176:0:14876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1ea12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1ea19 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401022.598201:0:14876:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1ea12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1ea19 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786401022.599007:0:14876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1786401022.599638:0:14876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1786401022.599905:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1786401022.599950:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1786401022.600015:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1786401022.600023:0:14876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1786401022.600130:0:14876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14876:1873176872181120:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786401022.600198:0:14876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401022.600237:0:14876:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc58f9600 going to sleep for 11 seconds 00000100:00100000:0.0:1786401022.600574:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872181120 00000100:00100000:0.0:1786401022.600583:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872181120 00000100:00100000:0.0:1786401022.600633:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1786401022.600642:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+15:14876:x1873176872181120:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786401022.600858:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+15:14876:x1873176872181120:12345-0@lo:501:mount.lustre.0 Request processed in 216us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401022.600865:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1786401022.600978:0:14876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14876:1873176872181120:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786401022.601014:0:14876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14876:1873176872181248:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786401022.601055:0:14876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401022.601160:0:14876:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc58f9600 going to sleep for 11 seconds 00000100:00100000:0.0:1786401022.601283:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872181248 00000100:00100000:0.0:1786401022.601288:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872181248 00000100:00100000:0.0:1786401022.601324:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1786401022.601333:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+15:14876:x1873176872181248:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786401022.601652:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+15:14876:x1873176872181248:12345-0@lo:503:mount.lustre.0 Request processed in 320us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401022.601660:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1786401022.602581:0:14876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14876:1873176872181248:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1786401022.603082:0:14876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1786401022.603411:0:14876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14876:1873176872181376:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786401022.603489:0:14876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401022.603622:0:14876:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc58f9600 going to sleep for 11 seconds 00000100:00100000:2.0:1786401022.603663:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872181376 00000100:00100000:2.0:1786401022.603669:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872181376 00000100:00100000:2.0:1786401022.603742:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1786401022.603751:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+15:14876:x1873176872181376:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1786401022.603949:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+15:14876:x1873176872181376:12345-0@lo:502:mount.lustre.0 Request processed in 198us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401022.603957:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1786401022.604047:0:14876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14876:1873176872181376:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1786401022.604343:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1786401022.604498:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1786401022.604572:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1786401022.604624:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1786401022.604660:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1786401022.604707:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1786401022.604748:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1786401022.604782:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1786401022.604816:0:14876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14876:1873176872181504:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1786401022.604869:0:14876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401022.605695:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872181504 00000100:00100000:1.0:1786401022.605710:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872181504 00000100:00100000:1.0:1786401022.605749:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1786401022.605756:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+15:14876:x1873176872181504:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786401022.605949:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+15:14876:x1873176872181504:12345-0@lo:502:mount.lustre.0 Request processed in 192us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401022.605957:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1786401022.606303:0:14876:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc4579480 going to sleep for 11 seconds 00000100:00100000:0.0:1786401022.606327:0:14876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14876:1873176872181504:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1786401022.606461:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1786401022.606490:0:14876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1786401022.607594:0:14894:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786401022.607606:0:14894:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786401022.607608:0:14894:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1786401022.607615:0:14894:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d6feddc7000 00000020:00000080:2.0:1786401022.607618:0:14894:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1786401022.607625:0:14894:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786401022.607627:0:14894:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786401022.607629:0:14894:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1786401022.607631:0:14894:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786401022.607633:0:14894:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786401022.607635:0:14894:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1786401022.607638:0:14894:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d6feddc7000 00000020:00000080:2.0:1786401022.607640:0:14894:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1786401022.607747:0:14894:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786401022.607760:0:14894:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786401022.607762:0:14894:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1786401022.607765:0:14894:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1786401022.607768:0:14894:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786401022.607769:0:14894:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1786401022.607772:0:14894:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d6feddc7000 00000020:00000080:2.0:1786401022.607774:0:14894:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1786401022.611284:0:14894:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1786401022.611296:0:14894:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1786401022.611298:0:14894:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1786401022.611302:0:14894:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1786401022.611616:0:14876:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1786401022.611649:0:14876:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1786401022.611674:0:14876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1ea12 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1ea19 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401022.611686:0:14876:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1ea12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1ea19 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786401022.611726:0:14876:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1786401022.611729:0:14876:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d6feddc7000 10000000:01000000:0.0:1786401022.611731:0:14876:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d6feddc7000 10000000:01000000:0.0:1786401022.611735:0:14876:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1786401022.611740:0:14876:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d6feddc7000 from 1 10000000:01000000:0.0:1786401022.611742:0:14876:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1786401022.611775:0:14876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1ea20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401022.611784:0:14876:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1ea20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401022.611794:0:14876:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1ea20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786401022.611816:0:14876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14876:1873176872181632:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1786401022.611879:0:14876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401022.615592:0:14876:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc4579000 going to sleep for 11 seconds 00000100:00100000:1.0:1786401022.615678:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872181632 00000100:00100000:1.0:1786401022.615689:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872181632 00000100:00100000:1.0:1786401022.615748:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1786401022.615758:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+15:14876:x1873176872181632:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786401022.615775:0:14236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786401022.615795:0:14236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fc138f600/0x5ccaaf4f3cb1ea27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1ea20 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401022.615824:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc138f600/0x5ccaaf4f3cb1ea27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1ea20 expref: 16 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401022.615835:0:14236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fc138f600/0x5ccaaf4f3cb1ea27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1ea20 expref: 16 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401022.615845:0:14236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138f600, rc 0) 00000100:00100000:1.0:1786401022.615917:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+16:14876:x1873176872181632:12345-0@lo:101:mount.lustre.0 Request processed in 159us (4037us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401022.615925:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1786401022.616029:0:14876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14876:1873176872181632:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786401022.616046:0:14876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1ea20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1ea27 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401022.616057:0:14876:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1ea20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1ea27 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786401022.616834:0:14876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1786401022.619675:0:14876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1786401022.620028:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1786401022.620080:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1786401022.620141:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1786401022.622496:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1786401022.622589:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1786401022.622670:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1786401022.622710:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1786401022.622747:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1786401022.622798:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1786401022.622836:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1786401022.622872:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1786401022.622924:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1786401022.622961:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1786401022.622995:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1786401022.623043:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1786401022.623078:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1786401022.624736:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1786401022.624831:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1786401022.624951:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1786401022.624989:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1786401022.625038:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1786401022.625109:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1786401022.625145:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1786401022.625203:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1786401022.625240:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1786401022.625274:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1786401022.625335:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1786401022.625563:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1786401022.625653:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1786401022.625661:0:14876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1786401022.625762:0:14876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14876:1873176872181760:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786401022.625826:0:14876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401022.625940:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872181760 00000100:00100000:0.0:1786401022.625948:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872181760 00000100:00100000:0.0:1786401022.625992:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1786401022.626001:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+16:14876:x1873176872181760:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786401022.626338:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+16:14876:x1873176872181760:12345-0@lo:501:mount.lustre.0 Request processed in 337us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401022.626347:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1786401022.626522:0:14876:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc4579000 going to sleep for 11 seconds 00000100:00100000:0.0:1786401022.626549:0:14876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14876:1873176872181760:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786401022.626585:0:14876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14876:1873176872181888:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786401022.626624:0:14876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401022.626652:0:14876:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc4579000 going to sleep for 11 seconds 00000100:00100000:1.0:1786401022.626806:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872181888 00000100:00100000:1.0:1786401022.626812:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872181888 00000100:00100000:1.0:1786401022.627285:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1786401022.627295:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+16:14876:x1873176872181888:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1786401022.627602:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+16:14876:x1873176872181888:12345-0@lo:503:mount.lustre.0 Request processed in 308us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401022.627609:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1786401022.627823:0:14876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14876:1873176872181888:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1786401022.628933:0:14876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1786401022.629012:0:14876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14876:1873176872182016:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1786401022.629071:0:14876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401022.629121:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872182016 00000100:00100000:0.0:1786401022.629132:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872182016 00000100:00100000:0.0:1786401022.629167:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1786401022.629176:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+16:14876:x1873176872182016:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1786401022.629377:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+16:14876:x1873176872182016:12345-0@lo:502:mount.lustre.0 Request processed in 201us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401022.629385:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1786401022.629446:0:14876:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffdbfb840 going to sleep for 11 seconds 00000100:00100000:0.0:1786401022.629477:0:14876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14876:1873176872182016:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1786401022.629701:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1786401022.629745:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1786401022.629774:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1786401022.629814:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1786401022.629846:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1786401022.629916:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1786401022.629956:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1786401022.629989:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1786401022.630035:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1786401022.630067:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1786401022.630120:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1786401022.630165:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1786401022.630197:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1786401022.630232:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1786401022.630278:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1786401022.630309:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1786401022.630338:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1786401022.630379:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1786401022.630416:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1786401022.630449:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1786401022.630515:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1786401022.630564:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1786401022.630605:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1786401022.630647:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1786401022.630677:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1786401022.630706:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1786401022.630747:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1786401022.630778:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1786401022.630810:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1786401022.630859:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1786401022.630895:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1786401022.630930:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1786401022.630965:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1786401022.631563:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1786401022.631618:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1786401022.631667:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1786401022.631702:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1786401022.631754:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1786401022.631805:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1786401022.631839:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1786401022.631893:0:14876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14876:1873176872182144:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1786401022.631964:0:14876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401022.632054:0:14876:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc9435900 going to sleep for 11 seconds 00000100:00100000:1.0:1786401022.635794:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872182144 00000100:00100000:1.0:1786401022.635810:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872182144 00000100:00100000:0.0:1786401022.636722:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1786401022.636736:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+16:14876:x1873176872182144:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1786401022.637037:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+16:14876:x1873176872182144:12345-0@lo:502:mount.lustre.0 Request processed in 304us (5072us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401022.637045:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1786401022.638204:0:14876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14876:1873176872182144:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1786401022.638334:0:14876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1786401022.638351:0:14876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00010000:00010000:1.0:1786401022.642272:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1786401022.646267:0:14899:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1786401022.646285:0:14899:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9d6fc33f3380) 00000020:00000080:0.0:1786401022.646304:0:14899:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1786401022.650972:0:14899:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d6feddc7000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1786401022.650989:0:14899:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d6feddc7000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1786401022.650992:0:14899:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d6feddc7000 3 00010000:00080000:0.0:1786401022.651029:0:14899:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d6fc2882800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.108@tcp at head 00010000:00010000:0.0:1786401022.655182:0:14899:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1786401022.655287:0:14899:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1786401022.655325:0:14899:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1786401022.655336:0:14899:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5ccaaf4f3cb1ea35 00000100:00080000:0.0:1786401022.655347:0:14899:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1786401022.657460:0:14899:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9d6fc2882800 using connection 192.168.204.108@tcp/0@lo 00000100:00100000:0.0:1786401022.657544:0:14899:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ffdc9bb80 x1873176872182272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1786401022.657581:0:14899:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1786401022.658165:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1873176872182272:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1786401022.658243:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786401022.658290:0:14241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872182272 00000100:00100000:2.0:1786401022.658299:0:14241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872182272 00000100:00080000:3.0:1786401022.658306:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1786401022.658311:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1786401022.658313:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1786401022.658322:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1786401022.658338:0:14241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1786401022.658346:0:14241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1873176872182272:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1786401022.658961:0:14241:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 475 last 0 00000020:00000080:2.0:1786401022.658999:0:14241:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5ccaaf4f3cb1ea3c 00000004:00100000:2.0:1786401022.659016:0:14241:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1786401022.659052:0:14241:0:(import.c:65:import_set_state_nolock()) ffff9d6fc28ea800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786401022.659187:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786401022.659201:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd892680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873176872182400:0@lo:400:kworker.0 00000100:00100000:0.0:1786401022.659232:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401022.659266:0:14243:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1786401022.659274:0:14243:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1786401022.659545:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872182400 00000100:00100000:0.0:1786401022.659551:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872182400 00000100:00100000:0.0:1786401022.659581:0:14243:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1786401022.659589:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1786401022.659596:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873176872182400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786401022.659635:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873176872182400:12345-0@lo:400:kworker.0 Request processed in 38us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401022.659641:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1786401022.659679:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6ffd892680 x1873176872182400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786401038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786401022.659693:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd892680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873176872182400:0@lo:400:kworker.0 00000100:00100000:2.0:1786401022.661642:0:14241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1873176872182272:12345-0@lo:38:llog_process_th.0 Request processed in 3286us (3390us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401022.661657:0:14241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:0.0:1786401022.672301:0:14899:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1786401022.672996:0:14876:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1786401022.673039:0:14876:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1786401022.673061:0:14876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1ea20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1ea27 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401022.673073:0:14876:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5ab400/0x5ccaaf4f3cb1ea20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1ea27 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1786401022.673148:0:14876:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1786401022.673151:0:14876:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1786401022.673152:0:14876:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786401022.673154:0:14876:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786401022.673155:0:14876:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786401022.673156:0:14876:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786401022.673158:0:14876:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786401022.673160:0:14876:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786401022.673161:0:14876:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1786401022.673165:0:14876:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1786401022.673168:0:14876:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1786401022.673169:0:14876:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1786401022.673170:0:14876:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786401022.673172:0:14876:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786401022.673173:0:14876:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786401022.673180:0:14876:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786401022.673181:0:14876:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786401022.673182:0:14876:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786401022.673183:0:14876:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1786401022.673211:0:14876:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1786401022.673232:0:14876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14876:1873176872182528:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1786401022.673311:0:14876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401022.673348:0:14876:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc4579480 going to sleep for 11 seconds 00000100:00100000:1.0:1786401022.673372:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872182528 00000100:00100000:1.0:1786401022.673378:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872182528 00000100:00100000:1.0:1786401022.673420:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1786401022.673429:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+16:14876:x1873176872182528:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1786401022.673455:0:14235:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1786401022.673479:0:14235:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1786401022.674640:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6ffdc9bb80 x1873176872182272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786401032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786401022.674653:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1786401022.674663:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1786401022.674671:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1786401022.674676:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1786401022.674679:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9d6fc2882800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1786401022.674686:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1873176872182272:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1786401022.735282:0:14235:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1786401022.735343:0:14235:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1786401022.736423:0:14257:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1786401022.736433:0:14257:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1786401022.736472:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d6fca090200/0x5ccaaf4f3cb1ea43 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401022.736492:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e9b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1e9a9 expref: 16 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401022.736500:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d6fca090200/0x5ccaaf4f3cb1ea43 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401022.736545:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e9b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5ccaaf4f3cb1e9a9 expref: 16 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401022.736560:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e9b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1e9a9 expref: 16 pid: 14235 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786401022.736576:0:14257:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd890700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14257:1873176872182656:0@lo:104: 00000100:00100000:3.0:1786401022.736641:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786401022.736723:0:14257:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc9c7ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1786401022.736877:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872182656 00000100:00100000:0.0:1786401022.736886:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872182656 00000100:00100000:0.0:1786401022.736942:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786401022.736952:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd892a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:054a13af-ec40-49d6-93c2-21045d196afe+3:14257:x1873176872182656:12345-0@lo:104: 00010000:00010000:0.0:1786401022.736964:0:14225:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.108@tcp lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e9a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1e9b0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401022.737030:0:14225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1786401022.737037:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd892a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:054a13af-ec40-49d6-93c2-21045d196afe+3:14257:x1873176872182656:12345-0@lo:104: Request processed in 87us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401022.737043:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1786401022.737064:0:14230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786401022.737071:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e9a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1e9b0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401022.737078:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca090c00 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:0.0:1786401022.737083:0:14230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e9a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5ccaaf4f3cb1e9b0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401022.737109:0:14230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e9a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5ccaaf4f3cb1e9b0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786401022.737117:0:14230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e9a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5ccaaf4f3cb1e9b0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786401022.737122:0:14230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1786401022.737150:0:14230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e9a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1e9b0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401022.737166:0:14230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786401022.737199:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e9a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1e9b0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401022.737206:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fca090c00/0x5ccaaf4f3cb1e9a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1e9b0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401022.737220:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786401022.737222:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786401022.737224:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786401022.737240:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:054a13af-ec40-49d6-93c2-21045d196afe:3306:1873176872182784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786401022.737269:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401022.737314:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872182784 00000100:00100000:0.0:1786401022.737319:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872182784 00010000:00010000:0.0:1786401022.737335:0:14228:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e9b0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1e9a9 expref: 17 pid: 14235 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786401022.737495:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786401022.737505:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:054a13af-ec40-49d6-93c2-21045d196afe+17:3306:x1873176872182784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786401022.737516:0:14228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786401022.737521:0:14228:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e9b0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1e9a9 expref: 17 pid: 14235 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401022.737532:0:14228:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e9b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1e9a9 expref: 17 pid: 14235 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401022.737548:0:14228:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d6fca090200/0x5ccaaf4f3cb1ea43 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401022.737566:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fca090200/0x5ccaaf4f3cb1ea43 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1786401022.737579:0:14228:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001427660s 00010000:00010000:0.0:1786401022.737584:0:14228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fca090200/0x5ccaaf4f3cb1ea43 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401022.737590:0:14228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fca090200/0x5ccaaf4f3cb1ea43 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401022.737597:0:14228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d6fca090200/0x5ccaaf4f3cb1ea43 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401022.737603:0:14228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d6fca090200/0x5ccaaf4f3cb1ea43 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401022.737608:0:14228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca090200 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:0.0:1786401022.737612:0:14228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d6fca090200/0x5ccaaf4f3cb1ea43 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401022.737620:0:14228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d6fca090200/0x5ccaaf4f3cb1ea43 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401022.737629:0:14228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d6fca090200/0x5ccaaf4f3cb1ea43 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401022.737639:0:14228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786401022.737671:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:054a13af-ec40-49d6-93c2-21045d196afe+17:3306:x1873176872182784:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401022.737679:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786401022.737723:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:054a13af-ec40-49d6-93c2-21045d196afe:3306:1873176872182784:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786401022.738148:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1e9b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1e9a9 expref: 16 pid: 14235 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786401022.738161:0:14257:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd890700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14257:1873176872182656:0@lo:104: 00010000:00010000:2.0:1786401022.738178:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d6fca090200/0x5ccaaf4f3cb1ea43 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401022.738212:0:14257:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d6fca090200/0x5ccaaf4f3cb1ea43 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401022.738218:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d6fca090200/0x5ccaaf4f3cb1ea43 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401022.738224:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fca090200/0x5ccaaf4f3cb1ea43 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786401022.758079:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+15:14876:x1873176872182528:12345-0@lo:253:mount.lustre.0 Request processed in 84639us (84763us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401022.758113:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1786401022.758265:0:14876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:14876:1873176872182528:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1786401022.758280:0:14876:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1786401022.758283:0:14876:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1786401022.758285:0:14876:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1786401022.758286:0:14876:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786401022.758288:0:14876:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786401022.758289:0:14876:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786401022.758290:0:14876:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786401022.758292:0:14876:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786401022.758294:0:14876:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786401022.758295:0:14876:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1786401022.758309:0:14876:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1786401022.764981:0:14876:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1786401022.770302:0:14876:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1786401022.770538:0:14876:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1786401022.770702:0:14876:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1786401022.770853:0:14876:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1786401022.771073:0:14876:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1786401022.772012:0:14876:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1786401022.837970:0:14876:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1786401022.837980:0:14876:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1786401022.838022:0:14876:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1786401022.838111:0:14876:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.108@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1786401022.838126:0:14876:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1786401022.838156:0:14876:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1786401023.662301:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1786401024.644057:0:14238:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1786401024.644063:0:14238:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9d6ec4cf8800 from 7 10000000:01000000:1.0:1786401024.644068:0:14238:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1786401024.644121:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f400/0x5ccaaf4f3cb1ea4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401024.644133:0:14238:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f400/0x5ccaaf4f3cb1ea4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401024.644165:0:14238:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f400/0x5ccaaf4f3cb1ea4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786401024.644190:0:14238:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:054a13af-ec40-49d6-93c2-21045d196afe:14238:1873176872182912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786401024.644250:0:14238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401024.644297:0:14238:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc9790f00 going to sleep for 11 seconds 00000100:00100000:0.0:1786401024.644534:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872182912 00000100:00100000:0.0:1786401024.644542:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872182912 00000100:00100000:0.0:1786401024.644598:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1786401024.644607:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4806850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+15:14238:x1873176872182912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786401024.644621:0:14236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786401024.644634:0:14236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1ea51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1ea4a expref: -99 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401024.644656:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1ea51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1ea4a expref: 16 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401024.644666:0:14236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1ea51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1ea4a expref: 16 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401024.644676:0:14236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5aa200, rc 0) 00000100:00100000:0.0:1786401024.644728:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4806850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+16:14238:x1873176872182912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401024.644735:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1786401024.644865:0:14238:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:054a13af-ec40-49d6-93c2-21045d196afe:14238:1873176872182912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786401024.644880:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f400/0x5ccaaf4f3cb1ea4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1ea51 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401024.644888:0:14238:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f400/0x5ccaaf4f3cb1ea4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1ea51 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786401024.644940:0:14238:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde21500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:054a13af-ec40-49d6-93c2-21045d196afe:14238:1873176872183040:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1786401024.644971:0:14238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786401024.645005:0:14238:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc45b90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786401024.645048:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872183040 00000100:00100000:0.0:1786401024.645052:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872183040 00000100:00100000:0.0:1786401024.645117:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1786401024.645124:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+16:14238:x1873176872183040:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1786401024.645138:0:14235:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1786401024.645165:0:14235:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1786401024.645168:0:14235:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1786401024.645240:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+16:14238:x1873176872183040:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 116us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401024.645247:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1786401024.645541:0:14238:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde21500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:054a13af-ec40-49d6-93c2-21045d196afe:14238:1873176872183040:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1786401024.645598:0:14238:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1786401024.645609:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f400/0x5ccaaf4f3cb1ea4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1ea51 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401024.645617:0:14238:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f400/0x5ccaaf4f3cb1ea4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1ea51 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401024.687069:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401025.711692:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786401026.735457:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401027.758432:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1786401027.829722:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1786401027.829729:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1786401027.829732:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1786401027.829735:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1786401027.829776:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:054a13af-ec40-49d6-93c2-21045d196afe:3307:1873176872183168:0@lo:400:kworker.0 00000100:00100000:0.0:1786401027.829845:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401027.829905:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873176872183296:0@lo:400:kworker.0 00000100:00100000:0.0:1786401027.830666:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401027.830700:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786401027.830706:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873176872183424:0@lo:400:kworker.0 00000100:00100000:0.0:1786401027.830740:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401027.830770:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872183168 00000100:00100000:0.0:1786401027.830778:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872183168 00000100:00100000:0.0:1786401027.830826:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1786401027.830835:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+16:3307:x1873176872183168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786401027.830900:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+16:3307:x1873176872183168:12345-0@lo:400:kworker.0 Request processed in 66us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401027.830908:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1786401027.830954:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872183296 00000100:00100000:0.0:1786401027.830957:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872183296 00000100:00100000:0.0:1786401027.830978:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872183424 00000100:00100000:0.0:1786401027.830980:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872183424 00000100:00100000:0.0:1786401027.831004:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786401027.831010:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873176872183296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786401027.831040:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873176872183296:12345-0@lo:400:kworker.0 Request processed in 30us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401027.831046:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786401027.831057:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786401027.831062:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873176872183424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786401027.831081:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873176872183424:12345-0@lo:400:kworker.0 Request processed in 20us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401027.831100:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786401027.831143:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:054a13af-ec40-49d6-93c2-21045d196afe:3307:1873176872183168:0@lo:400:kworker.0 00010000:00080000:0.0:1786401027.831183:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6ffdc98000 x1873176872183424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786401043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786401027.831195:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873176872183424:0@lo:400:kworker.0 00010000:00080000:0.0:1786401027.831204:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6ffdc9b100 x1873176872183296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786401043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786401027.831212:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873176872183296:0@lo:400:kworker.0 00000100:00080000:0.0:1786401027.831558:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1786401028.785701:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401029.807423:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786401030.169765:0:15243:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg408-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:0.0:1786401030.383784:0:14275:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1786401030.830830:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786401031.854598:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401032.878952:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1786401032.944249:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1786401032.944256:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1786401032.944269:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1786401032.944273:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1786401032.944319:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:054a13af-ec40-49d6-93c2-21045d196afe:3306:1873176872183552:0@lo:400:kworker.0 00000100:00100000:0.0:1786401032.945592:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401032.945664:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786401032.945675:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872183680:0@lo:400:kworker.0 00000100:00100000:0.0:1786401032.945715:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401032.945751:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873176872183808:0@lo:400:kworker.0 00000100:00100000:0.0:1786401032.945775:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401032.945811:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872183552 00000100:00100000:0.0:1786401032.945818:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872183552 00000100:00100000:0.0:1786401032.945859:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1786401032.945867:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+16:3306:x1873176872183552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786401032.947587:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+16:3306:x1873176872183552:12345-0@lo:400:kworker.0 Request processed in 1713us (1992us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401032.947600:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1786401032.947648:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872183680 00000100:00100000:0.0:1786401032.947655:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872183680 00000100:00100000:0.0:1786401032.947693:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872183808 00000100:00100000:0.0:1786401032.947697:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872183808 00000100:00100000:0.0:1786401032.947722:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1786401032.947729:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872183680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786401032.947779:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872183680:12345-0@lo:400:kworker.0 Request processed in 50us (2063us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401032.947786:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1786401032.947799:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1786401032.947805:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873176872183808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786401032.947838:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873176872183808:12345-0@lo:400:kworker.0 Request processed in 33us (2061us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401032.947843:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1786401032.947868:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1786401032.948551:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6ffdc9a300 x1873176872183808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786401048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786401032.948575:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873176872183808:0@lo:400:kworker.0 00000100:00100000:2.0:1786401032.953709:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:054a13af-ec40-49d6-93c2-21045d196afe:3306:1873176872183552:0@lo:400:kworker.0 00010000:00080000:2.0:1786401032.957282:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6ffdc98000 x1873176872183680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786401048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786401032.957301:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872183680:0@lo:400:kworker.0 00000100:00100000:2.0:1786401033.905305:0:3305:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786401018/real 1786401018] req@ffff9d6ffdc9aa00 x1873176872179200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786401033 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786401033.905337:0:3305:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d6ffdc9aa00 x1873176872179200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786401033 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786401033.905347:0:3305:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1786401018/real 1786401018] req@ffff9d6ffdc9ad80 x1873176872179328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786401033 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786401033.905357:0:3305:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d6ffdc9ad80 x1873176872179328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1786401033 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1786401033.905378:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9d6fc524a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786401033.905397:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1786401033.905408:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873176872179200:0@lo:8:kworker.0 00000100:00080000:2.0:1786401033.905415:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9d70004f1800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1786401033.905419:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1786401033.905422:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873176872179328:0@lo:8:kworker.0 00000100:00080000:1.0:1786401033.909281:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1786401033.909287:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1786401033.909291:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d6fc524a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786401033.909299:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 470 00000100:00080000:1.0:1786401033.909304:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1786401033.909311:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d6fc524a000 using connection 192.168.204.108@tcp/0@lo 00000100:00100000:1.0:1786401033.909335:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ff6fe1f80 x1873176872184064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1786401033.909353:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1786401033.909356:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1786401033.909358:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d70004f1800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786401033.909362:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 470 00000100:00080000:1.0:1786401033.909364:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1786401033.909368:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d70004f1800 using connection 192.168.204.108@tcp/0@lo 00000100:00100000:1.0:1786401033.909380:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ff6fe0000 x1873176872184192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786401033.909426:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873176872184064:0@lo:8:kworker.0 00000100:00100000:1.0:1786401033.909568:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401033.909627:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873176872184192:0@lo:8:kworker.0 00000100:00100000:1.0:1786401033.909650:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401033.909683:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872184320:0@lo:400:kworker.0 00000100:00100000:1.0:1786401033.909712:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401033.909731:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786401033.909736:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872184448:0@lo:400:kworker.0 00000100:00100000:1.0:1786401033.909761:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786401033.910014:0:14877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872184064 00000100:00100000:2.0:1786401033.910022:0:14877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872184064 00000100:00100000:2.0:1786401033.910059:0:14877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872184192 00000100:00100000:2.0:1786401033.910062:0:14877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872184192 00000100:00100000:2.0:1786401033.910076:0:14877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786401033.910083:0:14877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1873176872184064:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1786401033.910127:0:14877:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 486 last 0 00000020:00000080:2.0:1786401033.910324:0:14877:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5ccaaf4f3cb1ea58 00002000:00100000:2.0:1786401033.910338:0:14877:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9d6fc28ed000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1786401033.910342:0:14877:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1786401033.910345:0:14877:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1786401033.910899:0:14877:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1786401033.910924:0:14877:0:(import.c:65:import_set_state_nolock()) ffff9d6fc28eb800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786401033.911064:0:14877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1873176872184064:12345-0@lo:8:kworker.0 Request processed in 979us (1496us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401033.911072:0:14877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786401033.911118:0:14877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786401033.911124:0:14877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1873176872184192:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1786401033.911210:0:14877:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1786401033.911251:0:14877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1873176872184192:12345-0@lo:8:kworker.0 Request processed in 116us (1590us total) trans 0 rc -19/-19 00000100:00100000:2.0:1786401033.911257:0:14877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1786401033.911603:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6ff6fe1f80 x1873176872184064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1786401053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786401033.911614:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1786401033.911621:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1786401033.911630:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1786401033.911634:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1786401033.911637:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9d6fc524a000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1786401033.911660:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1786401033.911665:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873176872184064:0@lo:8:kworker.0 00000100:00080000:1.0:1786401033.911677:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9d70004f1800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786401033.911681:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1786401033.911684:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873176872184192:0@lo:8:kworker.0 00000004:00080000:1.0:1786401033.911710:0:14263:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1786401033.911974:0:14263:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 486312887065ns, next at 0ns, rc = 0 00000004:00080000:3.0:1786401033.912730:0:14264:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:3.0:1786401033.912754:0:14264:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd893100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14264:1873176872184704:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1786401033.912804:0:14264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786401033.912833:0:14264:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc34ebd80 going to sleep for 11 seconds 00000100:00100000:1.0:1786401033.913610:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872184704 00000100:00100000:1.0:1786401033.913619:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872184704 00000100:00100000:1.0:1786401033.913675:0:14880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1786401033.913684:0:14880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd892d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14264:x1873176872184704:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1786401033.914594:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872184320 00000100:00100000:3.0:1786401033.914600:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872184320 00000100:00100000:3.0:1786401033.914640:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872184448 00000100:00100000:3.0:1786401033.914643:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872184448 00000100:00100000:3.0:1786401033.914666:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1786401033.914674:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6fe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872184320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786401033.914747:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6fe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872184320:12345-0@lo:400:kworker.0 Request processed in 74us (5033us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401033.914754:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1786401033.914771:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1786401033.914776:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6fe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872184448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786401033.914806:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6fe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872184448:12345-0@lo:400:kworker.0 Request processed in 30us (5045us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401033.914813:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1786401033.914848:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd890a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872184576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786401033.914880:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786401033.914918:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1786401033.914925:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:054a13af-ec40-49d6-93c2-21045d196afe:3308:1873176872183936:0@lo:400:kworker.0 00000100:00100000:3.0:1786401033.914952:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786401033.915058:0:14881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872184576 00000100:00100000:2.0:1786401033.915062:0:14881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872184576 00000100:00100000:2.0:1786401033.915106:0:14881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786401033.915113:0:14881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1873176872184576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786401033.915218:0:14881:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786401033.915267:0:14881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1873176872184576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401033.915274:0:14881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1786401033.916116:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6ffd890a80 x1873176872184576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786401049 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1786401033.916212:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd890a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872184576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786401033.917693:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872183936 00000100:00100000:0.0:1786401033.917704:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872183936 00000100:00100000:0.0:1786401033.917748:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1786401033.917758:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+16:3308:x1873176872183936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786401033.917836:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+16:3308:x1873176872183936:12345-0@lo:400:kworker.0 Request processed in 78us (2881us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401033.917843:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00010000:3.0:1786401033.918054:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786401033.918765:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:054a13af-ec40-49d6-93c2-21045d196afe:3308:1873176872183936:0@lo:400:kworker.0 00000100:00080000:1.0:1786401033.920384:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1786401033.920451:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6ff6fe3800 x1873176872184448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786401049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786401033.920831:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872184448:0@lo:400:kworker.0 00010000:00080000:1.0:1786401033.920849:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6ff6fe0e00 x1873176872184320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786401049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786401033.920856:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872184320:0@lo:400:kworker.0 00002000:00080000:0.0:1786401033.927763:0:14880:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1786401033.927774:0:14880:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1786401033.927779:0:14880:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:3.0:1786401033.942769:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786401033.942782:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a1b769b/0x5ccaaf4f3cb1ea5f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.942798:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=486s v=(0 0) 00010000:00010000:3.0:1786401033.942802:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786401033.942808:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a1b769b/0x5ccaaf4f3cb1ea5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.942824:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a1b769b/0x5ccaaf4f3cb1ea5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.942832:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a1b769b/0x5ccaaf4f3cb1ea5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.942840:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a1b769b/0x5ccaaf4f3cb1ea5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.942912:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1786401033.945080:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786401033.945115:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000857657d8/0x5ccaaf4f3cb1ea66 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.946666:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=486s v=(0 0) 00010000:00010000:3.0:1786401033.946676:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786401033.946685:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000857657d8/0x5ccaaf4f3cb1ea66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.946701:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000857657d8/0x5ccaaf4f3cb1ea66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.946713:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000857657d8/0x5ccaaf4f3cb1ea66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.946722:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000857657d8/0x5ccaaf4f3cb1ea66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401033.946936:0:14230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786401033.946946:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a1b769b/0x5ccaaf4f3cb1ea5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401033.946956:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca090800 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:2.0:1786401033.946971:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a1b769b/0x5ccaaf4f3cb1ea5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401033.946981:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a1b769b/0x5ccaaf4f3cb1ea5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401033.947003:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a1b769b/0x5ccaaf4f3cb1ea5f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401033.947011:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a1b769b/0x5ccaaf4f3cb1ea5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401033.947288:0:14230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786401033.947294:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000857657d8/0x5ccaaf4f3cb1ea66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401033.947310:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca091800 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:0.0:1786401033.947313:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000857657d8/0x5ccaaf4f3cb1ea66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401033.947321:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000857657d8/0x5ccaaf4f3cb1ea66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401033.947333:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000857657d8/0x5ccaaf4f3cb1ea66 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401033.947341:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786401033.947343:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786401033.947345:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786401033.947440:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786401033.947446:0:14880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000857657d8/0x5ccaaf4f3cb1ea66 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401033.947533:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786401033.949293:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786401033.949304:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d88052ad/0x5ccaaf4f3cb1ea6d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.949319:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=486s v=(0 0) 00010000:00010000:3.0:1786401033.949322:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786401033.949335:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d88052ad/0x5ccaaf4f3cb1ea6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.949349:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d88052ad/0x5ccaaf4f3cb1ea6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.949357:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d88052ad/0x5ccaaf4f3cb1ea6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.949365:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d88052ad/0x5ccaaf4f3cb1ea6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.949429:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1786401033.950832:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786401033.950842:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ef923fa/0x5ccaaf4f3cb1ea74 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.950855:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=486s v=(0 0) 00010000:00010000:3.0:1786401033.950858:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786401033.950863:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ef923fa/0x5ccaaf4f3cb1ea74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.950875:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ef923fa/0x5ccaaf4f3cb1ea74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.950884:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ef923fa/0x5ccaaf4f3cb1ea74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.950902:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ef923fa/0x5ccaaf4f3cb1ea74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401033.955079:0:14230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786401033.955497:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d88052ad/0x5ccaaf4f3cb1ea6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401033.955512:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca090600 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:0.0:1786401033.955517:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d88052ad/0x5ccaaf4f3cb1ea6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401033.955528:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d88052ad/0x5ccaaf4f3cb1ea6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401033.955550:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d88052ad/0x5ccaaf4f3cb1ea6d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401033.955568:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d88052ad/0x5ccaaf4f3cb1ea6d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.959379:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1786401033.960123:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786401033.960212:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065b61831/0x5ccaaf4f3cb1ea7b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.960230:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=486s v=(0 0) 00010000:00010000:3.0:1786401033.960235:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786401033.960252:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065b61831/0x5ccaaf4f3cb1ea7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.960266:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065b61831/0x5ccaaf4f3cb1ea7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.960275:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065b61831/0x5ccaaf4f3cb1ea7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.960282:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065b61831/0x5ccaaf4f3cb1ea7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.960292:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1786401033.960752:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786401033.960759:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056379521/0x5ccaaf4f3cb1ea82 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.960775:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=486s v=(0 0) 00010000:00010000:3.0:1786401033.960778:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786401033.960783:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056379521/0x5ccaaf4f3cb1ea82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.960792:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056379521/0x5ccaaf4f3cb1ea82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.960800:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056379521/0x5ccaaf4f3cb1ea82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.960807:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056379521/0x5ccaaf4f3cb1ea82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.960816:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1786401033.961312:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786401033.961319:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005659cb11/0x5ccaaf4f3cb1ea89 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.961328:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=486s v=(0 0) 00010000:00010000:3.0:1786401033.961331:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786401033.961335:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005659cb11/0x5ccaaf4f3cb1ea89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.961343:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005659cb11/0x5ccaaf4f3cb1ea89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.961362:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005659cb11/0x5ccaaf4f3cb1ea89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.961368:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005659cb11/0x5ccaaf4f3cb1ea89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.961377:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1786401033.961942:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786401033.961949:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1ea90 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.962206:0:14230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1786401033.962214:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ef923fa/0x5ccaaf4f3cb1ea74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.962223:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca090a00 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:1.0:1786401033.962228:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ef923fa/0x5ccaaf4f3cb1ea74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.962247:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ef923fa/0x5ccaaf4f3cb1ea74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.962272:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ef923fa/0x5ccaaf4f3cb1ea74 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.962279:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ef923fa/0x5ccaaf4f3cb1ea74 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.962299:0:14230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1786401033.962303:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065b61831/0x5ccaaf4f3cb1ea7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.962321:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca091000 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:1.0:1786401033.962324:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065b61831/0x5ccaaf4f3cb1ea7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.962331:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065b61831/0x5ccaaf4f3cb1ea7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.962342:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065b61831/0x5ccaaf4f3cb1ea7b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.962348:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065b61831/0x5ccaaf4f3cb1ea7b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.962362:0:14230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786401033.962365:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056379521/0x5ccaaf4f3cb1ea82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.962371:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca091400 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:1.0:1786401033.962375:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056379521/0x5ccaaf4f3cb1ea82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.962382:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056379521/0x5ccaaf4f3cb1ea82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.962391:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056379521/0x5ccaaf4f3cb1ea82 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.962404:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056379521/0x5ccaaf4f3cb1ea82 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.962416:0:14230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786401033.962419:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005659cb11/0x5ccaaf4f3cb1ea89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.962425:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca091200 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:1.0:1786401033.962429:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005659cb11/0x5ccaaf4f3cb1ea89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.962437:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005659cb11/0x5ccaaf4f3cb1ea89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.962447:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005659cb11/0x5ccaaf4f3cb1ea89 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.962550:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=486s v=(0 0) 00010000:00010000:3.0:1786401033.962554:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786401033.962559:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1ea90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.962569:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1ea90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.962577:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1ea90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.962585:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1ea90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.962605:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786401033.963034:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005659cb11/0x5ccaaf4f3cb1ea89 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.963050:0:14230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786401033.963054:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1ea90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.963065:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca091600 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:1.0:1786401033.963074:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1ea90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.963083:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1ea90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.963112:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1ea90 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.963120:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1ea90 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.963204:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786401033.963207:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786401033.963209:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401033.963308:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786401033.965740:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786401033.965755:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000860d07d/0x5ccaaf4f3cb1ea97 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.965771:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=486s v=(0 0) 00010000:00010000:3.0:1786401033.965775:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786401033.965781:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000860d07d/0x5ccaaf4f3cb1ea97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.965794:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000860d07d/0x5ccaaf4f3cb1ea97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.965803:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000860d07d/0x5ccaaf4f3cb1ea97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.965811:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000860d07d/0x5ccaaf4f3cb1ea97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.965833:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786401033.965847:0:14230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786401033.965852:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000860d07d/0x5ccaaf4f3cb1ea97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.965860:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca090000 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:3.0:1786401033.965871:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000860d07d/0x5ccaaf4f3cb1ea97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.965880:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000860d07d/0x5ccaaf4f3cb1ea97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.965893:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000860d07d/0x5ccaaf4f3cb1ea97 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.965901:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000860d07d/0x5ccaaf4f3cb1ea97 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.965918:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786401033.965921:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786401033.965922:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786401033.968039:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786401033.968049:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1ea9e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.968062:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=486s v=(0 0) 00010000:00010000:3.0:1786401033.968066:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786401033.968072:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1ea9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.968116:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1ea9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.968126:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1ea9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.968212:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1ea9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.968230:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1786401033.968726:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786401033.968732:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b951b0ca/0x5ccaaf4f3cb1eaa5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.968741:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=486s v=(0 0) 00010000:00010000:3.0:1786401033.968744:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786401033.968748:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b951b0ca/0x5ccaaf4f3cb1eaa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.968758:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b951b0ca/0x5ccaaf4f3cb1eaa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.968766:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b951b0ca/0x5ccaaf4f3cb1eaa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.968774:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b951b0ca/0x5ccaaf4f3cb1eaa5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.968792:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1786401033.968803:0:14230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786401033.968808:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1ea9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.968822:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca090e00 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:3.0:1786401033.968826:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1ea9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.968836:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1ea9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.968850:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1ea9e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.968857:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1ea9e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.968874:0:14230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786401033.968878:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b951b0ca/0x5ccaaf4f3cb1eaa5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.968885:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca090200 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:3.0:1786401033.968888:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b951b0ca/0x5ccaaf4f3cb1eaa5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.968895:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b951b0ca/0x5ccaaf4f3cb1eaa5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.968903:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b951b0ca/0x5ccaaf4f3cb1eaa5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.968915:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b951b0ca/0x5ccaaf4f3cb1eaa5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.968926:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786401033.968928:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786401033.968930:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401033.969595:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786401033.969769:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786401033.969776:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1a483a6/0x5ccaaf4f3cb1eaac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.969785:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=486s v=(0 0) 00010000:00010000:3.0:1786401033.969788:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786401033.969792:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1a483a6/0x5ccaaf4f3cb1eaac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.969801:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1a483a6/0x5ccaaf4f3cb1eaac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.969808:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1a483a6/0x5ccaaf4f3cb1eaac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.969815:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1a483a6/0x5ccaaf4f3cb1eaac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.969870:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1786401033.975251:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786401033.975275:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000860d07d/0x5ccaaf4f3cb1eab3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.975293:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=486s v=(0 0) 00010000:00010000:3.0:1786401033.975297:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786401033.975303:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000860d07d/0x5ccaaf4f3cb1eab3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.975317:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000860d07d/0x5ccaaf4f3cb1eab3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.975328:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000860d07d/0x5ccaaf4f3cb1eab3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.975336:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000860d07d/0x5ccaaf4f3cb1eab3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401033.977706:0:14230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786401033.977721:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1a483a6/0x5ccaaf4f3cb1eaac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401033.977734:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca090c00 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:2.0:1786401033.977738:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1a483a6/0x5ccaaf4f3cb1eaac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401033.977749:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1a483a6/0x5ccaaf4f3cb1eaac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401033.977770:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1a483a6/0x5ccaaf4f3cb1eaac lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401033.977778:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1a483a6/0x5ccaaf4f3cb1eaac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401033.977811:0:14230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786401033.977816:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000860d07d/0x5ccaaf4f3cb1eab3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401033.977823:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca090000 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:2.0:1786401033.977826:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000860d07d/0x5ccaaf4f3cb1eab3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401033.977840:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000860d07d/0x5ccaaf4f3cb1eab3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401033.977861:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000860d07d/0x5ccaaf4f3cb1eab3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401033.977869:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401033.977871:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401033.977873:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786401033.981276:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786401033.981292:0:14880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000860d07d/0x5ccaaf4f3cb1eab3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786401033.982348:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786401033.982358:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b951b0ca/0x5ccaaf4f3cb1eaba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.982372:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=486s v=(0 0) 00010000:00010000:3.0:1786401033.982376:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786401033.982389:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b951b0ca/0x5ccaaf4f3cb1eaba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.982405:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b951b0ca/0x5ccaaf4f3cb1eaba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.982415:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b951b0ca/0x5ccaaf4f3cb1eaba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.982423:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b951b0ca/0x5ccaaf4f3cb1eaba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.982447:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1786401033.982927:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786401033.982933:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1eac1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.982943:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=486s v=(0 0) 00010000:00010000:3.0:1786401033.982946:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786401033.982950:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1eac1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.982959:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1eac1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.982966:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1eac1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.982984:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1eac1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.982993:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1786401033.983234:0:14230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786401033.983253:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b951b0ca/0x5ccaaf4f3cb1eaba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.983261:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca090200 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:1.0:1786401033.983266:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b951b0ca/0x5ccaaf4f3cb1eaba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.983274:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b951b0ca/0x5ccaaf4f3cb1eaba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.983290:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b951b0ca/0x5ccaaf4f3cb1eaba lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.983304:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b951b0ca/0x5ccaaf4f3cb1eaba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.983323:0:14230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786401033.983326:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1eac1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.983332:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca090e00 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:1.0:1786401033.983335:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1eac1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.983343:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1eac1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.983353:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1eac1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.983361:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1eac1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.983373:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786401033.983374:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786401033.983376:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786401033.983767:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786401033.983773:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000857657d8/0x5ccaaf4f3cb1eac8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.983782:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=486s v=(0 0) 00010000:00010000:3.0:1786401033.983786:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786401033.983790:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000857657d8/0x5ccaaf4f3cb1eac8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.983799:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000857657d8/0x5ccaaf4f3cb1eac8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.983807:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000857657d8/0x5ccaaf4f3cb1eac8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.983815:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000857657d8/0x5ccaaf4f3cb1eac8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.984001:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1786401033.984543:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786401033.984550:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1eacf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.984565:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=486s v=(0 0) 00010000:00010000:3.0:1786401033.984567:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786401033.984571:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1eacf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.984581:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1eacf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.984588:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1eacf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.984594:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1eacf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.985071:0:14230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786401033.985077:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000857657d8/0x5ccaaf4f3cb1eac8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.985104:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca091800 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:1.0:1786401033.985108:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000857657d8/0x5ccaaf4f3cb1eac8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.985117:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000857657d8/0x5ccaaf4f3cb1eac8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401033.985791:0:14229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786401033.986027:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000857657d8/0x5ccaaf4f3cb1eac8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.986038:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000857657d8/0x5ccaaf4f3cb1eac8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.986055:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786401033.986057:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786401033.986059:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786401033.986709:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786401033.986717:0:14229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1eacf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.986726:0:14229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca091600 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:1.0:1786401033.986731:0:14229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1eacf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.986744:0:14229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1eacf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.986772:0:14229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1eacf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401033.986780:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786401033.986781:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786401033.986783:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786401033.986788:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786401033.986790:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786401033.987324:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786401033.987332:0:14880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1eacf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.990253:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786401033.990927:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786401033.990936:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005659cb11/0x5ccaaf4f3cb1ead6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.990950:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=486s v=(0 0) 00010000:00010000:3.0:1786401033.990955:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786401033.993230:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005659cb11/0x5ccaaf4f3cb1ead6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.993278:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005659cb11/0x5ccaaf4f3cb1ead6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.993288:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005659cb11/0x5ccaaf4f3cb1ead6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.993296:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005659cb11/0x5ccaaf4f3cb1ead6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.993317:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786401033.993331:0:14229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786401033.993336:0:14229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005659cb11/0x5ccaaf4f3cb1ead6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.993343:0:14229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca091200 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:3.0:1786401033.993347:0:14229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005659cb11/0x5ccaaf4f3cb1ead6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.993355:0:14229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005659cb11/0x5ccaaf4f3cb1ead6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.993370:0:14229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005659cb11/0x5ccaaf4f3cb1ead6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.993377:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005659cb11/0x5ccaaf4f3cb1ead6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.993405:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786401033.993407:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786401033.993409:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786401033.994344:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786401033.994352:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056379521/0x5ccaaf4f3cb1eadd lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.994364:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=486s v=(0 0) 00010000:00010000:3.0:1786401033.994369:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786401033.994374:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056379521/0x5ccaaf4f3cb1eadd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.994384:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056379521/0x5ccaaf4f3cb1eadd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.994393:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056379521/0x5ccaaf4f3cb1eadd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.994400:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056379521/0x5ccaaf4f3cb1eadd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.994419:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1786401033.994897:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786401033.994903:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065b61831/0x5ccaaf4f3cb1eae4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.994922:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=486s v=(0 0) 00010000:00010000:3.0:1786401033.994925:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786401033.994929:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065b61831/0x5ccaaf4f3cb1eae4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.994939:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065b61831/0x5ccaaf4f3cb1eae4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.994947:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065b61831/0x5ccaaf4f3cb1eae4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.994955:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065b61831/0x5ccaaf4f3cb1eae4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.994974:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1786401033.997335:0:14230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786401033.997350:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056379521/0x5ccaaf4f3cb1eadd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401033.997362:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca091400 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:2.0:1786401033.997367:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056379521/0x5ccaaf4f3cb1eadd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401033.997376:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056379521/0x5ccaaf4f3cb1eadd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401033.997396:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056379521/0x5ccaaf4f3cb1eadd lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401033.997404:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056379521/0x5ccaaf4f3cb1eadd lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401033.997426:0:14230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786401033.997430:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065b61831/0x5ccaaf4f3cb1eae4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401033.997443:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca091000 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:2.0:1786401033.997446:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065b61831/0x5ccaaf4f3cb1eae4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401033.997453:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065b61831/0x5ccaaf4f3cb1eae4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401033.997464:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065b61831/0x5ccaaf4f3cb1eae4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401033.997470:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065b61831/0x5ccaaf4f3cb1eae4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401033.997484:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401033.997485:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401033.997487:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786401033.997888:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786401033.999728:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786401033.999742:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000860d07d/0x5ccaaf4f3cb1eaeb lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.999758:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=486s v=(0 0) 00010000:00010000:3.0:1786401033.999762:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786401033.999769:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000860d07d/0x5ccaaf4f3cb1eaeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.999783:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000860d07d/0x5ccaaf4f3cb1eaeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.999801:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000860d07d/0x5ccaaf4f3cb1eaeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.999809:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000860d07d/0x5ccaaf4f3cb1eaeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401033.999875:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1786401034.001293:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786401034.001302:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ef923fa/0x5ccaaf4f3cb1eaf2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.001314:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=486s v=(0 0) 00010000:00010000:3.0:1786401034.001317:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786401034.001322:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ef923fa/0x5ccaaf4f3cb1eaf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.001335:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ef923fa/0x5ccaaf4f3cb1eaf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.001344:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ef923fa/0x5ccaaf4f3cb1eaf2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.001672:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ef923fa/0x5ccaaf4f3cb1eaf2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401034.003574:0:14229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786401034.003586:0:14229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000860d07d/0x5ccaaf4f3cb1eaeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401034.003598:0:14229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca090000 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:1.0:1786401034.003603:0:14229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000860d07d/0x5ccaaf4f3cb1eaeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401034.003612:0:14229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000860d07d/0x5ccaaf4f3cb1eaeb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401034.003632:0:14229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000860d07d/0x5ccaaf4f3cb1eaeb lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401034.003639:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000860d07d/0x5ccaaf4f3cb1eaeb lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401034.003660:0:14229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786401034.003673:0:14229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ef923fa/0x5ccaaf4f3cb1eaf2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401034.003680:0:14229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca090a00 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:1.0:1786401034.003683:0:14229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ef923fa/0x5ccaaf4f3cb1eaf2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401034.003690:0:14229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ef923fa/0x5ccaaf4f3cb1eaf2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401034.003699:0:14229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ef923fa/0x5ccaaf4f3cb1eaf2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401034.003705:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786401034.003707:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786401034.003708:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786401034.006919:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786401034.006934:0:14880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ef923fa/0x5ccaaf4f3cb1eaf2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786401034.008450:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786401034.008461:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1eaf9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.008476:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=486s v=(0 0) 00010000:00010000:3.0:1786401034.008480:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786401034.008486:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1eaf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.008500:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1eaf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.008510:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1eaf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.008517:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1eaf9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.008533:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786401034.008545:0:15374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786401034.008551:0:15374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1eaf9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.008564:0:15374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca091600 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:3.0:1786401034.008569:0:15374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1eaf9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.008577:0:15374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1eaf9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.008593:0:15374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1eaf9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.008601:0:15374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1eaf9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.008615:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786401034.008617:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786401034.008619:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786401034.009229:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786401034.009235:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d88052ad/0x5ccaaf4f3cb1eb00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.009256:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=486s v=(0 0) 00010000:00010000:3.0:1786401034.009260:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786401034.009264:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d88052ad/0x5ccaaf4f3cb1eb00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.009274:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d88052ad/0x5ccaaf4f3cb1eb00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.009433:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d88052ad/0x5ccaaf4f3cb1eb00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.009441:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d88052ad/0x5ccaaf4f3cb1eb00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.009462:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1786401034.009899:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786401034.009906:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a1b769b/0x5ccaaf4f3cb1eb07 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.009915:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=486s v=(0 0) 00010000:00010000:3.0:1786401034.009918:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786401034.009922:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a1b769b/0x5ccaaf4f3cb1eb07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.009931:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a1b769b/0x5ccaaf4f3cb1eb07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.009938:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a1b769b/0x5ccaaf4f3cb1eb07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.009945:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a1b769b/0x5ccaaf4f3cb1eb07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.009973:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1786401034.009984:0:15374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1786401034.009988:0:15374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d88052ad/0x5ccaaf4f3cb1eb00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.009995:0:15374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca090600 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:3.0:1786401034.009999:0:15374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d88052ad/0x5ccaaf4f3cb1eb00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.010008:0:15374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d88052ad/0x5ccaaf4f3cb1eb00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.010021:0:15374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d88052ad/0x5ccaaf4f3cb1eb00 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.010029:0:15374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d88052ad/0x5ccaaf4f3cb1eb00 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.010044:0:15374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786401034.010048:0:15374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a1b769b/0x5ccaaf4f3cb1eb07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.010055:0:15374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca090800 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:3.0:1786401034.010058:0:15374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a1b769b/0x5ccaaf4f3cb1eb07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.010077:0:15374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a1b769b/0x5ccaaf4f3cb1eb07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401034.010080:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786401034.010103:0:15374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a1b769b/0x5ccaaf4f3cb1eb07 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.010111:0:15374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a1b769b/0x5ccaaf4f3cb1eb07 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.010123:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786401034.010125:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786401034.010127:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786401034.010839:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786401034.010846:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065b61831/0x5ccaaf4f3cb1eb0e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.010856:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=486s v=(0 0) 00010000:00010000:3.0:1786401034.010859:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786401034.010864:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065b61831/0x5ccaaf4f3cb1eb0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.010873:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065b61831/0x5ccaaf4f3cb1eb0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.010881:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065b61831/0x5ccaaf4f3cb1eb0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.010898:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065b61831/0x5ccaaf4f3cb1eb0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.010920:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786401034.010988:0:14229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786401034.010994:0:14229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065b61831/0x5ccaaf4f3cb1eb0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401034.011001:0:14229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca091000 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:2.0:1786401034.011005:0:14229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065b61831/0x5ccaaf4f3cb1eb0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401034.011013:0:14229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065b61831/0x5ccaaf4f3cb1eb0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401034.011033:0:14229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065b61831/0x5ccaaf4f3cb1eb0e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401034.011040:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065b61831/0x5ccaaf4f3cb1eb0e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401034.011056:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401034.011058:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401034.011060:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786401034.011705:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786401034.011712:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056379521/0x5ccaaf4f3cb1eb15 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401034.012126:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786401034.012440:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=486s v=(0 0) 00010000:00010000:3.0:1786401034.012445:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786401034.012451:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056379521/0x5ccaaf4f3cb1eb15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.012465:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056379521/0x5ccaaf4f3cb1eb15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.012474:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056379521/0x5ccaaf4f3cb1eb15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.012481:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056379521/0x5ccaaf4f3cb1eb15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.012788:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1786401034.013304:0:14880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786401034.013312:0:14880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000857657d8/0x5ccaaf4f3cb1eb1c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.013326:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=486s v=(0 0) 00010000:00010000:3.0:1786401034.013330:0:14880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786401034.013335:0:14880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000857657d8/0x5ccaaf4f3cb1eb1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.013424:0:14880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000857657d8/0x5ccaaf4f3cb1eb1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.013433:0:14880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000857657d8/0x5ccaaf4f3cb1eb1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401034.013441:0:14880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000857657d8/0x5ccaaf4f3cb1eb1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401034.016014:0:15374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786401034.016029:0:15374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056379521/0x5ccaaf4f3cb1eb15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401034.016042:0:15374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca091400 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:2.0:1786401034.016047:0:15374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056379521/0x5ccaaf4f3cb1eb15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401034.016057:0:15374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056379521/0x5ccaaf4f3cb1eb15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401034.016077:0:15374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056379521/0x5ccaaf4f3cb1eb15 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401034.016098:0:15374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056379521/0x5ccaaf4f3cb1eb15 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401034.016290:0:15374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786401034.016295:0:15374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000857657d8/0x5ccaaf4f3cb1eb1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401034.016303:0:15374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca091800 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:2.0:1786401034.016306:0:15374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000857657d8/0x5ccaaf4f3cb1eb1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401034.016314:0:15374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000857657d8/0x5ccaaf4f3cb1eb1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401034.016324:0:15374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000857657d8/0x5ccaaf4f3cb1eb1c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401034.016331:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401034.016332:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401034.016334:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786401034.016635:0:14880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1786401034.016643:0:14880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000857657d8/0x5ccaaf4f3cb1eb1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401034.016825:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1786401034.016978:0:14880:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:3.0:1786401034.017082:0:14880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd892d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14264:x1873176872184704:12345-0@lo:5:osp-pre-0-0.0 Request processed in 103396us (104274us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401034.017116:0:14880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1786401034.017322:0:14264:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd893100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14264:1873176872184704:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1786401034.017339:0:14264:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:2.0:1786401034.017384:0:14264:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde21500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14264:1873176872184832:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1786401034.017419:0:14264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786401034.017507:0:14264:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff6ec99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786401034.018952:0:14878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872184832 00000100:00100000:0.0:1786401034.018964:0:14878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872184832 00000100:00100000:0.0:1786401034.019049:0:14878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786401034.019060:0:14878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14264:x1873176872184832:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1786401034.019130:0:14878:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000004:00080000:3.0:1786401034.022385:0:5810:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1786401034.024664:0:14878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14264:x1873176872184832:12345-0@lo:5:osp-pre-0-0.0 Request processed in 5599us (7237us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1786401034.024677:0:14878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1786401034.024801:0:14264:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde21500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14264:1873176872184832:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1786401034.024827:0:14264:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:2.0:1786401034.926403:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401035.952031:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786401036.974678:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1786401037.898660:0:15546:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1786401037.898665:0:15546:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1786401037.898826:0:15546:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9d6fc28ea000 00000020:01000004:2.0:1786401037.898844:0:15546:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1786401037.898857:0:15546:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1786401037.898873:0:15546:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9d6fc4f299c0) 00000020:00000080:2.0:1786401037.898889:0:15546:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1786401037.953048:0:15546:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1786401037.954669:0:15546:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1786401037.958299:0:15546:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1786401037.958606:0:15546:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1786401037.958816:0:15546:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1786401037.960744:0:15546:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 529: rc = 0 00100000:10000000:2.0:1786401037.960845:0:15546:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 529: rc = 0 00100000:10000000:2.0:1786401037.962812:0:15546:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 529: rc = 0 00100000:10000000:2.0:1786401037.968168:0:15546:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 769: rc = 0 00100000:10000000:2.0:1786401037.968500:0:15546:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 769: rc = 0 00100000:10000000:2.0:1786401037.974065:0:15546:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 769: rc = 0 00100000:10000000:2.0:1786401037.974415:0:15546:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 769: rc = 0 00100000:10000000:2.0:1786401037.974677:0:15546:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 769: rc = 0 00100000:10000000:2.0:1786401037.976833:0:15546:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 769: rc = 0 00000020:00000080:2.0:1786401037.978595:0:15546:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1786401037.978614:0:15546:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1786401037.978626:0:15546:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5ccaaf4f3cb1eb2a 00000020:01000004:2.0:1786401037.978634:0:15546:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1786401037.978656:0:15546:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.108@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1786401037.978660:0:15546:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.108@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1786401037.978672:0:15546:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1786401037.978695:0:15546:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1786401037.978699:0:15546:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.108@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00010000:00010000:2.0:1786401038.000351:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1786401038.005351:0:15546:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.108@tcp ctxt 0 is initialized 00000020:01000004:0.0:1786401038.005394:0:15546:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.108@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1786401038.005399:0:15546:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1786401038.005401:0:15546:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1786401038.005402:0:15546:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786401038.005403:0:15546:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786401038.005405:0:15546:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786401038.005407:0:15546:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786401038.005408:0:15546:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786401038.005410:0:15546:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786401038.005411:0:15546:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1786401038.005415:0:15546:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1786401038.005417:0:15546:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1786401038.005418:0:15546:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1786401038.005419:0:15546:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786401038.005420:0:15546:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786401038.005422:0:15546:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786401038.005423:0:15546:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786401038.005423:0:15546:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786401038.005425:0:15546:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786401038.005430:0:15546:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1786401038.005457:0:15546:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1786401038.005478:0:15546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc9a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:15546:1873176872184960:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1786401038.005552:0:15546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401038.007646:0:15546:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffde64f00 going to sleep for 11 seconds 00000100:00100000:2.0:1786401038.008306:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872184960 00000100:00100000:2.0:1786401038.008317:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872184960 00000100:00100000:0.0:1786401038.009739:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1786401038.009752:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+16:15546:x1873176872184960:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1786401038.009805:0:14233:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1786401038.009808:0:14233:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1786401038.009812:0:14233:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1786401038.038521:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+16:15546:x1873176872184960:12345-0@lo:253:mount.lustre.0 Request processed in 28758us (32954us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401038.038541:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1786401038.038723:0:15546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc9a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:15546:1873176872184960:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1786401038.038740:0:15546:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1786401038.038744:0:15546:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1786401038.038746:0:15546:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1786401038.038748:0:15546:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1786401038.038749:0:15546:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1786401038.038750:0:15546:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1786401038.038752:0:15546:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1786401038.038754:0:15546:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1786401038.038756:0:15546:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1786401038.038757:0:15546:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1786401038.038783:0:15546:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d6fc28ea000 from lustre-OST0001 10000000:01000000:0.0:1786401038.038809:0:15546:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1786401038.038813:0:15546:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1786401038.038820:0:15546:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d6fe90399c0 local copy 00010000:00010000:0.0:1786401038.038832:0:15546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e400/0x5ccaaf4f3cb1e8d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1e8d7 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786401038.042711:0:15546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:15546:1873176872185088:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1786401038.042787:0:15546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401038.042866:0:15546:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc56c0240 going to sleep for 11 seconds 00000100:00100000:0.0:1786401038.042966:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872185088 00000100:00100000:0.0:1786401038.042974:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872185088 00000100:00100000:0.0:1786401038.044170:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1786401038.044190:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+16:15546:x1873176872185088:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786401038.044465:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+16:15546:x1873176872185088:12345-0@lo:501:mount.lustre.0 Request processed in 283us (1678us total) trans 0 rc -2/-2 00000100:00100000:0.0:1786401038.044474:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1786401038.046246:0:15546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:15546:1873176872185088:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1786401038.046276:0:15546:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.108@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1786401038.047322:0:15546:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.108@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1786401038.047334:0:15546:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e400/0x5ccaaf4f3cb1e8d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1e8d7 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401038.047347:0:15546:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fc138e400/0x5ccaaf4f3cb1e8d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1e8d7 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786401038.047379:0:15546:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d6fc28ea000 10000000:01000000:1.0:1786401038.047383:0:15546:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1786401038.047388:0:15546:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1786401038.047391:0:15546:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1786401038.047395:0:15546:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1786401038.047398:0:15546:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1786401038.047433:0:15546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f000/0x5ccaaf4f3cb1eb31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401038.047441:0:15546:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f000/0x5ccaaf4f3cb1eb31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401038.047452:0:15546:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f000/0x5ccaaf4f3cb1eb31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786401038.047472:0:15546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:15546:1873176872185216:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1786401038.047525:0:15546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401038.047905:0:15546:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc56c0240 going to sleep for 11 seconds 00000100:00100000:2.0:1786401038.048708:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872185216 00000100:00100000:2.0:1786401038.048716:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872185216 00000100:00100000:1.0:1786401038.048823:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1786401038.048831:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+16:15546:x1873176872185216:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1786401038.048848:0:14235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786401038.048867:0:14235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fc138e800/0x5ccaaf4f3cb1eb38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1eb31 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401038.048906:0:14235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc138e800/0x5ccaaf4f3cb1eb38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1eb31 expref: 17 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401038.049032:0:14235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fc138e800/0x5ccaaf4f3cb1eb38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1eb31 expref: 17 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401038.049130:0:14235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138e800, rc 0) 00000100:00100000:1.0:1786401038.049204:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+17:15546:x1873176872185216:12345-0@lo:101:mount.lustre.0 Request processed in 373us (1678us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401038.049211:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1786401038.049308:0:15546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:15546:1873176872185216:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1786401038.049325:0:15546:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f000/0x5ccaaf4f3cb1eb31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1eb38 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401038.049334:0:15546:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f000/0x5ccaaf4f3cb1eb31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1eb38 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1786401038.050274:0:15546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1786401038.051452:0:15546:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1786401038.051694:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1786401038.051732:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1786401038.051760:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1786401038.051812:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1786401038.051844:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1786401038.051870:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1786401038.052205:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1786401038.052213:0:15546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1786401038.052295:0:15546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde21880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:15546:1873176872185344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1786401038.052348:0:15546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786401038.052392:0:15546:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fcb36dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1786401038.052464:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872185344 00000100:00100000:0.0:1786401038.052471:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872185344 00000100:00100000:0.0:1786401038.052555:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1786401038.052563:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+17:15546:x1873176872185344:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786401038.052870:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+17:15546:x1873176872185344:12345-0@lo:501:mount.lustre.0 Request processed in 307us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401038.053145:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1786401038.053283:0:15546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde21880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:15546:1873176872185344:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786401038.053318:0:15546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd890a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:15546:1873176872185472:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786401038.053356:0:15546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786401038.053386:0:15546:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fff87db40 going to sleep for 11 seconds 00000100:00100000:2.0:1786401038.053423:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872185472 00000100:00100000:2.0:1786401038.053427:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872185472 00000100:00100000:2.0:1786401038.053457:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1786401038.053465:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+17:15546:x1873176872185472:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1786401038.057456:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+17:15546:x1873176872185472:12345-0@lo:503:mount.lustre.0 Request processed in 3981us (4089us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401038.057472:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1786401038.057577:0:15546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd890a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:15546:1873176872185472:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1786401038.058490:0:15546:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1786401038.058574:0:15546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd890a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:15546:1873176872185600:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786401038.058632:0:15546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786401038.059456:0:15546:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fff87db40 going to sleep for 11 seconds 00000100:00100000:0.0:1786401038.059673:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872185600 00000100:00100000:0.0:1786401038.059682:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872185600 00000100:00100000:0.0:1786401038.059836:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1786401038.059848:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+17:15546:x1873176872185600:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1786401038.060971:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+17:15546:x1873176872185600:12345-0@lo:502:mount.lustre.0 Request processed in 1122us (2335us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401038.060982:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1786401038.062024:0:15546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd890a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:15546:1873176872185600:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1786401038.062435:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1786401038.062502:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1786401038.062538:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1786401038.062591:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1786401038.062629:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1786401038.062663:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1786401038.062714:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1786401038.062766:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1786401038.062819:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1786401038.062861:0:15546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd890a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:15546:1873176872185728:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786401038.064300:0:15546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786401038.064500:0:15546:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fff87db40 going to sleep for 11 seconds 00000100:00100000:0.0:1786401038.065011:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872185728 00000100:00100000:0.0:1786401038.065020:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872185728 00000100:00100000:3.0:1786401038.081424:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1786401038.081451:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+17:15546:x1873176872185728:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786401038.081743:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+17:15546:x1873176872185728:12345-0@lo:502:mount.lustre.0 Request processed in 305us (17447us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401038.081760:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1786401038.081835:0:15546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd890a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:15546:1873176872185728:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1786401038.082053:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1786401038.082069:0:15546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1786401038.090404:0:15547:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1786401038.090416:0:15547:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1786401038.090423:0:15547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786401038.090426:0:15547:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1786401038.090432:0:15547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1786401038.090456:0:15547:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9d6ec60a19c0) 00000020:00000080:3.0:1786401038.090479:0:15547:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1786401038.090486:0:15547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1786401038.090553:0:15547:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d6fc28ea000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1786401038.090561:0:15547:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1786401038.090567:0:15547:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5ccaaf4f3cb1eb46 00010000:00010000:3.0:1786401038.126490:0:15547:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1786401038.126850:0:15547:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:3.0:1786401038.155037:0:15547:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1786401038.176791:0:15547:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1786401038.176805:0:15547:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786401038.176815:0:15547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786401038.176817:0:15547:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1786401038.176823:0:15547:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786401038.176826:0:15547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786401038.176828:0:15547:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1786401038.176831:0:15547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1786401038.176833:0:15547:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1786401038.176835:0:15547:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786401038.176838:0:15547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786401038.176839:0:15547:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1786401038.176856:0:15547:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1786401038.176858:0:15547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786401038.176860:0:15547:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1786401038.176864:0:15547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1786401038.177358:0:15547:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1786401038.177364:0:15547:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1786401038.177366:0:15547:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1786401038.177370:0:15547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1786401038.182408:0:15546:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1786401038.182447:0:15546:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1786401038.182466:0:15546:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f000/0x5ccaaf4f3cb1eb31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1eb38 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401038.182479:0:15546:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f000/0x5ccaaf4f3cb1eb31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1eb38 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786401038.182487:0:15546:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6fc28ea000 from 1 10000000:01000000:3.0:1786401038.182490:0:15546:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1786401038.182526:0:15546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fca091800/0x5ccaaf4f3cb1eb4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401038.182534:0:15546:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fca091800/0x5ccaaf4f3cb1eb4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401038.182545:0:15546:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fca091800/0x5ccaaf4f3cb1eb4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786401038.182571:0:15546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd890a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:15546:1873176872185856:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1786401038.182643:0:15546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786401038.182689:0:15546:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fff87d480 going to sleep for 11 seconds 00000100:00100000:3.0:1786401038.182736:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872185856 00000100:00100000:3.0:1786401038.182749:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872185856 00000100:00100000:3.0:1786401038.182795:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1786401038.182803:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+17:15546:x1873176872185856:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786401038.182817:0:14235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786401038.182829:0:14235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fca090800/0x5ccaaf4f3cb1eb54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1eb4d expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401038.182872:0:14235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fca090800/0x5ccaaf4f3cb1eb54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1eb4d expref: 18 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401038.182885:0:14235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fca090800/0x5ccaaf4f3cb1eb54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1eb4d expref: 18 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401038.182894:0:14235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca090800, rc 0) 00000100:00100000:3.0:1786401038.182943:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+18:15546:x1873176872185856:12345-0@lo:101:mount.lustre.0 Request processed in 139us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401038.182950:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1786401038.184183:0:15546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd890a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:15546:1873176872185856:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1786401038.184205:0:15546:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fca091800/0x5ccaaf4f3cb1eb4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1eb54 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401038.184215:0:15546:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fca091800/0x5ccaaf4f3cb1eb4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1eb54 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786401038.184803:0:15546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1786401038.193896:0:15546:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1786401038.194411:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1786401038.194473:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1786401038.194543:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1786401038.194560:0:15546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1786401038.194656:0:15546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd890a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:15546:1873176872185984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1786401038.194721:0:15546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786401038.194766:0:15546:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fff87d480 going to sleep for 11 seconds 00000100:00100000:0.0:1786401038.195053:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872185984 00000100:00100000:0.0:1786401038.195061:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872185984 00000100:00100000:0.0:1786401038.195128:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1786401038.195139:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+18:15546:x1873176872185984:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786401038.195396:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+18:15546:x1873176872185984:12345-0@lo:501:mount.lustre.0 Request processed in 258us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401038.195404:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1786401038.195456:0:15546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd890a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:15546:1873176872185984:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786401038.195489:0:15546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc9a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:15546:1873176872186112:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786401038.195524:0:15546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401038.195545:0:15546:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffcfa9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1786401038.196072:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872186112 00000100:00100000:3.0:1786401038.196078:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872186112 00000100:00100000:3.0:1786401038.196123:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1786401038.196131:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+18:15546:x1873176872186112:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1786401038.196450:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+18:15546:x1873176872186112:12345-0@lo:503:mount.lustre.0 Request processed in 318us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401038.196457:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1786401038.196676:0:15546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc9a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:15546:1873176872186112:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1786401038.198636:0:15546:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1786401038.198725:0:15546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc9a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:15546:1873176872186240:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1786401038.198801:0:15546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401038.198845:0:15546:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffcfa9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1786401038.200178:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872186240 00000100:00100000:2.0:1786401038.200191:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872186240 00000100:00100000:2.0:1786401038.200240:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1786401038.200250:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+18:15546:x1873176872186240:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1786401038.200527:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+18:15546:x1873176872186240:12345-0@lo:502:mount.lustre.0 Request processed in 277us (1724us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401038.200535:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1786401038.208708:0:15546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc9a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:15546:1873176872186240:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1786401038.209358:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1786401038.209423:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1786401038.209473:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1786401038.209511:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1786401038.209543:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1786401038.209595:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1786401038.209633:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1786401038.209667:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1786401038.209710:0:15546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc9a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:15546:1873176872186368:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1786401038.209792:0:15546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401038.209835:0:15546:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffcfa9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1786401038.214245:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872186368 00000100:00100000:3.0:1786401038.214260:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872186368 00000100:00100000:3.0:1786401038.214325:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1786401038.214335:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec4c04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+18:15546:x1873176872186368:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1786401038.214600:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec4c04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+18:15546:x1873176872186368:12345-0@lo:502:mount.lustre.0 Request processed in 266us (4807us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401038.214608:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1786401038.214655:0:15546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc9a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:15546:1873176872186368:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1786401038.214794:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1786401038.214810:0:15546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1786401038.220451:0:15552:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786401038.220464:0:15552:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786401038.220474:0:15552:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1786401038.220482:0:15552:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d6fc28ea000 00000020:00000080:0.0:1786401038.220484:0:15552:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1786401038.220491:0:15552:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786401038.220494:0:15552:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786401038.220496:0:15552:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1786401038.220498:0:15552:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786401038.220501:0:15552:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786401038.220502:0:15552:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1786401038.220505:0:15552:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d6fc28ea000 00000020:00000080:0.0:1786401038.220507:0:15552:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1786401038.220567:0:15552:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786401038.220570:0:15552:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786401038.220572:0:15552:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1786401038.220574:0:15552:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1786401038.220577:0:15552:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786401038.220578:0:15552:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1786401038.220582:0:15552:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d6fc28ea000 00000020:00000080:0.0:1786401038.220584:0:15552:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1786401038.220620:0:15552:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1786401038.220623:0:15552:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1786401038.220625:0:15552:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1786401038.220628:0:15552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1786401038.220969:0:15546:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1786401038.220996:0:15546:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1786401038.221024:0:15546:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fca091800/0x5ccaaf4f3cb1eb4d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1eb54 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401038.221036:0:15546:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fca091800/0x5ccaaf4f3cb1eb4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1eb54 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786401038.221077:0:15546:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1786401038.221080:0:15546:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d6fc28ea000 10000000:01000000:3.0:1786401038.221107:0:15546:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d6fc28ea000 10000000:01000000:3.0:1786401038.221112:0:15546:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1786401038.221117:0:15546:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d6fc28ea000 from 1 10000000:01000000:3.0:1786401038.221120:0:15546:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1786401038.221170:0:15546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fca090600/0x5ccaaf4f3cb1eb5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401038.221180:0:15546:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fca090600/0x5ccaaf4f3cb1eb5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401038.221192:0:15546:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fca090600/0x5ccaaf4f3cb1eb5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786401038.221220:0:15546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd890000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:15546:1873176872186496:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1786401038.221287:0:15546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786401038.221320:0:15546:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fff87d900 going to sleep for 11 seconds 00000100:00100000:0.0:1786401038.222017:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872186496 00000100:00100000:0.0:1786401038.222027:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872186496 00000100:00100000:0.0:1786401038.222069:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1786401038.222078:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef69b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+18:15546:x1873176872186496:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786401038.222115:0:14236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786401038.222130:0:14236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1eb62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1eb5b expref: -99 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401038.222166:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1eb62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1eb5b expref: 19 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401038.222186:0:14236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ffd5aa400/0x5ccaaf4f3cb1eb62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1eb5b expref: 19 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401038.222194:0:14236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5aa400, rc 0) 00000100:00100000:0.0:1786401038.222237:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef69b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+19:15546:x1873176872186496:12345-0@lo:101:mount.lustre.0 Request processed in 160us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401038.222244:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1786401038.222294:0:15546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd890000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:15546:1873176872186496:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1786401038.222306:0:15546:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fca090600/0x5ccaaf4f3cb1eb5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1eb62 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401038.222314:0:15546:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fca090600/0x5ccaaf4f3cb1eb5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1eb62 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1786401038.222890:0:15546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1786401038.223341:0:15546:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1786401038.223571:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1786401038.223614:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1786401038.223649:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1786401038.223694:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1786401038.223732:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1786401038.223780:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1786401038.223815:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1786401038.223850:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1786401038.223898:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1786401038.223934:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1786401038.223969:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1786401038.224031:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1786401038.224069:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1786401038.224122:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1786401038.224183:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1786401038.224215:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1786401038.224242:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1786401038.224280:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1786401038.224309:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1786401038.224353:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1786401038.224392:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1786401038.224421:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1786401038.224447:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1786401038.224484:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1786401038.224512:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1786401038.224538:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1786401038.224577:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1786401038.224605:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1786401038.224631:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1786401038.224668:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1786401038.224695:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1786401038.224722:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1786401038.224748:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1786401038.224784:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1786401038.232352:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1786401038.232486:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1786401038.232528:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1786401038.232631:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1786401038.232640:0:15546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1786401038.232758:0:15546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc9a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:15546:1873176872186624:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786401038.232831:0:15546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401038.233320:0:15546:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffcfa9840 going to sleep for 11 seconds 00000100:00100000:0.0:1786401038.233599:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872186624 00000100:00100000:0.0:1786401038.233607:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872186624 00000100:00100000:0.0:1786401038.233658:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1786401038.233667:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef699050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+19:15546:x1873176872186624:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786401038.236072:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef699050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+19:15546:x1873176872186624:12345-0@lo:501:mount.lustre.0 Request processed in 2396us (3231us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401038.236109:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1786401038.236210:0:15546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc9a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:15546:1873176872186624:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1786401038.236266:0:15546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc9a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:15546:1873176872186752:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786401038.236319:0:15546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401038.236353:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872186752 00000100:00100000:0.0:1786401038.236359:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872186752 00000100:00100000:0.0:1786401038.236395:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1786401038.236403:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef69ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+19:15546:x1873176872186752:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1786401038.236669:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef69ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+19:15546:x1873176872186752:12345-0@lo:503:mount.lustre.0 Request processed in 265us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401038.236677:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1786401038.236729:0:15546:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffcfa9840 going to sleep for 11 seconds 00000100:00100000:0.0:1786401038.236741:0:15546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc9a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:15546:1873176872186752:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1786401038.242344:0:15546:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1786401038.242440:0:15546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc9a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:15546:1873176872186880:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1786401038.242522:0:15546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401038.243072:0:15546:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffcfa9840 going to sleep for 11 seconds 00000100:00100000:1.0:1786401038.252167:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872186880 00000100:00100000:1.0:1786401038.252181:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872186880 00000100:00100000:1.0:1786401038.252251:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1786401038.252262:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef698050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+19:15546:x1873176872186880:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786401038.252609:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef698050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+19:15546:x1873176872186880:12345-0@lo:502:mount.lustre.0 Request processed in 349us (10087us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401038.252617:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1786401038.252670:0:15546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc9a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:15546:1873176872186880:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1786401038.253002:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1786401038.253061:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1786401038.253129:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1786401038.253192:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1786401038.253232:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1786401038.253285:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1786401038.253325:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1786401038.253360:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1786401038.253413:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1786401038.253450:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1786401038.253485:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1786401038.253535:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1786401038.253572:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1786401038.253606:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1786401038.253652:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1786401038.253703:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1786401038.253738:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1786401038.253788:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1786401038.253826:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1786401038.253861:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1786401038.257114:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1786401038.257189:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1786401038.257227:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1786401038.257279:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1786401038.257318:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1786401038.257351:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1786401038.257392:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1786401038.257421:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1786401038.257448:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1786401038.257496:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1786401038.257533:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1786401038.257568:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1786401038.257600:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1786401038.257649:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1786401038.257687:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1786401038.257736:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1786401038.257775:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1786401038.257811:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1786401038.257860:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1786401038.260628:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1786401038.260702:0:15546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:15546:1873176872187008:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786401038.260791:0:15546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401038.260833:0:15546:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc544a900 going to sleep for 11 seconds 00000100:00100000:1.0:1786401038.262068:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872187008 00000100:00100000:1.0:1786401038.262081:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872187008 00000100:00100000:1.0:1786401038.262175:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1786401038.262184:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef69a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+19:15546:x1873176872187008:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1786401038.262437:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef69a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+19:15546:x1873176872187008:12345-0@lo:502:mount.lustre.0 Request processed in 253us (1644us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401038.262445:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1786401038.262510:0:15546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:15546:1873176872187008:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1786401038.262608:0:15546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1786401038.262621:0:15546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1786401038.265427:0:15558:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1786401038.265443:0:15558:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9d6fc33f4d40) 00000020:00000080:0.0:1786401038.265465:0:15558:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1786401038.265589:0:15558:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d6fc28ea000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1786401038.265599:0:15558:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d6fc28ea000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1786401038.265602:0:15558:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d6fc28ea000 3 00010000:00080000:0.0:1786401038.265632:0:15558:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d6ec470e000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.108@tcp at head 00010000:00010000:0.0:1786401038.267167:0:15558:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1786401038.267273:0:15558:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1786401038.267305:0:15558:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1786401038.267316:0:15558:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5ccaaf4f3cb1eb70 00000100:00080000:0.0:1786401038.267326:0:15558:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1786401038.267332:0:15558:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9d6ec470e000 using connection 192.168.204.108@tcp/0@lo 00000100:00100000:0.0:1786401038.267367:0:15558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ffdc99c00 x1873176872187136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786401038.267409:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1873176872187136:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1786401038.267468:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1786401038.267521:0:15558:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1786401038.267560:0:12743:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1786401038.267564:0:12743:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1786401038.267566:0:12743:0:(import.c:65:import_set_state_nolock()) ffff9d70004f1800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1786401038.267570:0:12743:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 486 00000100:00080000:0.0:1786401038.267575:0:12743:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1786401038.267579:0:12743:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d70004f1800 using connection 192.168.204.108@tcp/0@lo 00000100:00100000:0.0:1786401038.267590:0:12743:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ffdc9ad80 x1873176872187392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1786401038.267624:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1786401038.267631:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872187264:0@lo:400:kworker.0 00000100:00100000:0.0:1786401038.267658:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401038.267678:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872187520:0@lo:400:kworker.0 00000100:00100000:0.0:1786401038.267704:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401038.267718:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786401038.267723:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872187648:0@lo:400:kworker.0 00000100:00100000:0.0:1786401038.267739:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401038.267760:0:14902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872187136 00000100:00100000:0.0:1786401038.267766:0:14902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872187136 00000100:00100000:0.0:1786401038.267787:0:14902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872187520 00000100:00100000:0.0:1786401038.267789:0:14902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872187520 00000100:00100000:0.0:1786401038.267806:0:14902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872187648 00000100:00100000:0.0:1786401038.267808:0:14902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872187648 00000100:00100000:0.0:1786401038.267829:0:14902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1786401038.267836:0:14902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872187520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786401038.267882:0:14902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872187520:12345-0@lo:400:kworker.0 Request processed in 45us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401038.269858:0:14902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1786401038.272754:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1786401038.272779:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872187648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786401038.272896:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1873176872187648:12345-0@lo:400:kworker.0 Request processed in 128us (5155us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401038.272905:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1786401038.272937:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1786401038.272942:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1873176872187136:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1786401038.272965:0:14243:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 490 last 0 00000020:00000080:3.0:1786401038.273001:0:14243:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5ccaaf4f3cb1eb77 00000004:00100000:3.0:1786401038.273018:0:14243:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1786401038.273051:0:14243:0:(import.c:65:import_set_state_nolock()) ffff9d6fc49f7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786401038.273101:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1873176872187136:12345-0@lo:38:llog_process_th.0 Request processed in 142us (5616us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401038.273115:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1786401038.273137:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872187264 00000100:00100000:3.0:1786401038.273144:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872187264 00000100:00100000:3.0:1786401038.273197:0:14880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786401038.273204:0:14880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3308:x1873176872187264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786401038.273245:0:14880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3308:x1873176872187264:12345-0@lo:400:kworker.0 Request processed in 41us (5586us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401038.273251:0:14880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1786401038.273295:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872187264:0@lo:400:kworker.0 00000100:00080000:0.0:1786401038.275462:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786401038.275473:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1786401038.275530:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6ffdc98000 x1873176872187648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786401054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786401038.275546:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1873176872187648:0@lo:400:kworker.0 00010000:00080000:0.0:1786401038.275560:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6ffdc9aa00 x1873176872187520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786401054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786401038.275569:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872187520:0@lo:400:kworker.0 00000100:00100000:1.0:1786401038.275801:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873176872187392:0@lo:8:kworker.0 00000100:00100000:1.0:1786401038.275864:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1786401038.275921:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6ffdc99c00 x1873176872187136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1786401048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1786401038.275930:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1786401038.275937:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1786401038.275946:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1786401038.275952:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1786401038.275955:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9d6ec470e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1786401038.275962:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1873176872187136:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1786401038.275988:0:14878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872187392 00000100:00100000:1.0:1786401038.275994:0:14878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872187392 00000100:00100000:1.0:1786401038.276028:0:14878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1786401038.276034:0:14878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6fe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1873176872187392:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1786401038.276101:0:14878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6fe3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1873176872187392:12345-0@lo:8:kworker.0 Request processed in 48us (219us total) trans 0 rc -11/-11 00000100:00100000:1.0:1786401038.276108:0:14878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1786401038.276131:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1786401038.276135:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9d70004f1800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1786401038.276147:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1786401038.276149:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873176872187392:0@lo:8:kworker.0 00000040:00080000:1.0:1786401038.276793:0:15558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1786401038.276842:0:15546:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1786401038.276864:0:15546:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1786401038.276889:0:15546:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fca090600/0x5ccaaf4f3cb1eb5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1eb62 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401038.276901:0:15546:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fca090600/0x5ccaaf4f3cb1eb5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1eb62 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1786401038.276978:0:15546:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1786401038.276981:0:15546:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1786401038.276982:0:15546:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786401038.276983:0:15546:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786401038.276984:0:15546:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786401038.276986:0:15546:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786401038.276988:0:15546:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786401038.276990:0:15546:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786401038.276992:0:15546:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1786401038.276996:0:15546:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1786401038.276998:0:15546:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1786401038.277000:0:15546:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1786401038.277001:0:15546:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786401038.277002:0:15546:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786401038.277003:0:15546:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786401038.277005:0:15546:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786401038.277006:0:15546:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786401038.277007:0:15546:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786401038.277008:0:15546:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1786401038.277031:0:15546:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1786401038.277047:0:15546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:15546:1873176872187776:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1786401038.277115:0:15546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401038.277145:0:15546:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fcbb3ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1786401038.277179:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872187776 00000100:00100000:1.0:1786401038.277184:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872187776 00000100:00100000:1.0:1786401038.277218:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1786401038.277226:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef699450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+19:15546:x1873176872187776:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1786401038.277254:0:14236:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1786401038.277267:0:14236:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00080000:0.0:1786401038.292698:0:6619:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1786401038.292720:0:6619:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 20000000:01000000:2.0:1786401038.306119:0:14236:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1786401038.306140:0:14236:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1786401038.307438:0:14257:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1786401038.307447:0:14257:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1786401038.307487:0:14257:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1eb7e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401038.307507:0:14257:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1ea51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1ea4a expref: 19 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401038.307517:0:14257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1eb7e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401038.307558:0:14257:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1ea51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5ccaaf4f3cb1ea4a expref: 19 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401038.307571:0:14257:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1ea51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1ea4a expref: 19 pid: 14236 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786401038.307586:0:14257:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc9aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14257:1873176872187904:0@lo:104: 00000100:00100000:0.0:1786401038.307648:0:14257:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401038.307693:0:14257:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fcb36d480 going to sleep for 11 seconds 00000100:00100000:1.0:1786401038.308266:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872187904 00000100:00100000:1.0:1786401038.308276:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872187904 00000100:00100000:1.0:1786401038.308325:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1786401038.308334:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:054a13af-ec40-49d6-93c2-21045d196afe+3:14257:x1873176872187904:12345-0@lo:104: 00010000:00010000:1.0:1786401038.308350:0:14224:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f400/0x5ccaaf4f3cb1ea4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1ea51 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401038.308406:0:14224:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1786401038.308413:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:054a13af-ec40-49d6-93c2-21045d196afe+3:14257:x1873176872187904:12345-0@lo:104: Request processed in 80us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401038.308419:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1786401038.308442:0:15374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786401038.308448:0:15374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f400/0x5ccaaf4f3cb1ea4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1ea51 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401038.308455:0:15374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138f400 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:1.0:1786401038.308460:0:15374:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f400/0x5ccaaf4f3cb1ea4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5ccaaf4f3cb1ea51 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401038.308470:0:15374:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f400/0x5ccaaf4f3cb1ea4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5ccaaf4f3cb1ea51 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1786401038.308478:0:15374:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f400/0x5ccaaf4f3cb1ea4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5ccaaf4f3cb1ea51 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1786401038.308495:0:15374:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1786401038.308529:0:15374:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f400/0x5ccaaf4f3cb1ea4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1ea51 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401038.308536:0:15374:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1786401038.308559:0:15374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f400/0x5ccaaf4f3cb1ea4a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1ea51 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401038.308565:0:15374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fc138f400/0x5ccaaf4f3cb1ea4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1ea51 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401038.308583:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786401038.308585:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786401038.308586:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786401038.308604:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:054a13af-ec40-49d6-93c2-21045d196afe:3308:1873176872188032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786401038.308633:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401038.308672:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872188032 00000100:00100000:1.0:1786401038.308676:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872188032 00010000:00010000:1.0:1786401038.308691:0:14228:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1ea51 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1ea4a expref: 20 pid: 14236 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786401038.308711:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1786401038.308717:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6fe1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:054a13af-ec40-49d6-93c2-21045d196afe+20:3308:x1873176872188032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786401038.308727:0:14228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786401038.308731:0:14228:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1ea51 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1ea4a expref: 20 pid: 14236 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401038.308741:0:14228:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1ea51 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1ea4a expref: 20 pid: 14236 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401038.308762:0:14228:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1eb7e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401038.308770:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1eb7e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1786401038.308783:0:14228:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001427660s 00010000:00010000:1.0:1786401038.308787:0:14228:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1eb7e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401038.308793:0:14228:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1eb7e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401038.308800:0:14228:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1eb7e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401038.308806:0:14228:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1eb7e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401038.308811:0:14228:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aaa00 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:1.0:1786401038.308816:0:14228:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1eb7e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401038.308822:0:14228:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1eb7e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401038.308831:0:14228:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1eb7e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401038.308840:0:14228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786401038.308868:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6fe1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:054a13af-ec40-49d6-93c2-21045d196afe+20:3308:x1873176872188032:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401038.308993:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1786401038.309033:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:054a13af-ec40-49d6-93c2-21045d196afe:3308:1873176872188032:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786401038.309127:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1ea51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1ea4a expref: 19 pid: 14236 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786401038.309140:0:14257:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc9aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14257:1873176872187904:0@lo:104: 00010000:00010000:0.0:1786401038.309166:0:14257:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1eb7e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401038.309175:0:14257:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1eb7e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401038.309181:0:14257:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1eb7e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401038.309198:0:14257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1eb7e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786401038.320626:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef699450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+18:15546:x1873176872187776:12345-0@lo:253:mount.lustre.0 Request processed in 43388us (43499us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401038.320646:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1786401038.320737:0:15546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:054a13af-ec40-49d6-93c2-21045d196afe:15546:1873176872187776:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1786401038.320752:0:15546:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1786401038.320755:0:15546:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1786401038.320758:0:15546:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1786401038.320759:0:15546:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1786401038.320760:0:15546:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1786401038.320762:0:15546:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1786401038.320763:0:15546:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1786401038.320764:0:15546:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1786401038.320767:0:15546:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1786401038.320768:0:15546:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1786401038.320782:0:15546:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1786401038.325675:0:15546:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1786401038.326544:0:15546:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1786401038.326762:0:15546:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1786401038.326990:0:15546:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1786401038.327166:0:15546:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1786401038.327372:0:15546:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1786401038.328292:0:15546:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1786401038.371676:0:15546:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1786401038.371691:0:15546:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1786401038.371728:0:15546:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1786401038.371796:0:15546:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.108@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1786401038.371812:0:15546:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1786401038.371851:0:15546:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1786401039.028016:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786401039.087174:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd891c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872188160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786401039.087259:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786401039.087422:0:14881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872188160 00000100:00100000:3.0:1786401039.087431:0:14881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872188160 00000100:00100000:3.0:1786401039.087482:0:14881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1786401039.087577:0:14881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872188160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786401039.087617:0:14881:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786401039.087665:0:14881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872188160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401039.087673:0:14881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786401039.087762:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1786401039.087787:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd891c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872188160:0@lo:13:osp-pre-0-0.0 10000000:01000000:1.0:1786401039.985237:0:14238:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1786401039.985245:0:14238:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9d6ec4cf8800 from 8 10000000:01000000:1.0:1786401039.985251:0:14238:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1786401039.985302:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1eb85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401039.985315:0:14238:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1eb85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401039.985347:0:14238:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1eb85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786401039.985373:0:14238:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:054a13af-ec40-49d6-93c2-21045d196afe:14238:1873176872188288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1786401039.985443:0:14238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401039.985627:0:14238:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc56c06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1786401039.988906:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872188288 00000100:00100000:0.0:1786401039.988921:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872188288 00000100:00100000:0.0:1786401039.988982:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1786401039.988991:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef699c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+18:14238:x1873176872188288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786401039.989009:0:14233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786401039.989183:0:14233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ffd5aa000/0x5ccaaf4f3cb1eb8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1eb85 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401039.989212:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ffd5aa000/0x5ccaaf4f3cb1eb8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1eb85 expref: 19 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401039.989224:0:14233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ffd5aa000/0x5ccaaf4f3cb1eb8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1eb85 expref: 19 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401039.989235:0:14233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5aa000, rc 0) 00000100:00100000:0.0:1786401039.989319:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef699c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+19:14238:x1873176872188288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 328us (3875us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401039.989326:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1786401039.989669:0:14238:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:054a13af-ec40-49d6-93c2-21045d196afe:14238:1873176872188288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786401039.989689:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1eb85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1eb8c expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401039.989699:0:14238:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1eb85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1eb8c expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786401039.989769:0:14238:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd893800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:054a13af-ec40-49d6-93c2-21045d196afe:14238:1873176872188416:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1786401039.989816:0:14238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786401039.989855:0:14238:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc56af300 going to sleep for 11 seconds 00000100:00100000:3.0:1786401039.989879:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872188416 00000100:00100000:3.0:1786401039.989884:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872188416 00000100:00100000:3.0:1786401039.989913:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1786401039.989920:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef69b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+19:14238:x1873176872188416:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1786401039.989934:0:14236:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1786401039.989950:0:14236:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1786401039.989953:0:14236:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1786401039.990151:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef69b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+19:14238:x1873176872188416:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 229us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401039.990158:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1786401039.990193:0:14238:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd893800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:054a13af-ec40-49d6-93c2-21045d196afe:14238:1873176872188416:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1786401039.990244:0:14238:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1786401039.990252:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1eb85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1eb8c expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401039.990260:0:14238:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fc138ee00/0x5ccaaf4f3cb1eb85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1eb8c expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401040.046739:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1786401040.628885:0:14275:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1786401041.070266:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786401042.094409:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786401043.124263:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1786401043.701515:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1786401043.701523:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1786401043.701526:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d70004f1800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1786401043.701538:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d70004f1800 using connection 192.168.204.108@tcp/0@lo 00000100:00100000:1.0:1786401043.701559:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ff6fe2a00 x1873176872188800/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1786401043.701643:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872188672:0@lo:400:kworker.0 00000100:00100000:1.0:1786401043.701712:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401043.701770:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1786401043.701776:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:054a13af-ec40-49d6-93c2-21045d196afe:3307:1873176872188544:0@lo:400:kworker.0 00000100:00100000:1.0:1786401043.701804:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401043.701826:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1873176872189184:0@lo:400:kworker.0 00000100:00100000:1.0:1786401043.701849:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401043.701873:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873176872188800:0@lo:8:kworker.0 00000100:00100000:1.0:1786401043.701895:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401043.701937:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873176872188928:0@lo:400:kworker.0 00000100:00100000:1.0:1786401043.701959:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401043.701977:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1786401043.701982:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6fe3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873176872189056:0@lo:400:kworker.0 00000100:00100000:1.0:1786401043.702000:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401043.702029:0:14877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872188672 00000100:00100000:1.0:1786401043.702037:0:14877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872188672 00000100:00100000:2.0:1786401043.702243:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872189184 00000100:00100000:2.0:1786401043.702248:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872189184 00000100:00100000:2.0:1786401043.702300:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872188928 00000100:00100000:2.0:1786401043.702304:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872188928 00000100:00100000:2.0:1786401043.702315:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872189056 00000100:00100000:2.0:1786401043.702318:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872189056 00000100:00100000:2.0:1786401043.702429:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1786401043.702439:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1873176872189184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786401043.702492:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1873176872189184:12345-0@lo:400:kworker.0 Request processed in 55us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401043.702500:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1786401043.702515:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1786401043.702521:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873176872188928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786401043.702551:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873176872188928:12345-0@lo:400:kworker.0 Request processed in 30us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401043.702556:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1786401043.702566:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1786401043.702571:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6fe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873176872189056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786401043.702594:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6fe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873176872189056:12345-0@lo:400:kworker.0 Request processed in 23us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401043.702599:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1786401043.702616:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872188544 00000100:00100000:2.0:1786401043.702619:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872188544 00000100:00100000:2.0:1786401043.702641:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1786401043.702647:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef698850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+19:3307:x1873176872188544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786401043.702673:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef698850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+19:3307:x1873176872188544:12345-0@lo:400:kworker.0 Request processed in 26us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401043.702679:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1786401043.702705:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786401043.703039:0:14877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872188800 00000100:00100000:1.0:1786401043.703044:0:14877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872188800 00000100:00100000:1.0:1786401043.703070:0:14877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786401043.703077:0:14877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6fe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872188672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786401043.703122:0:14877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6fe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872188672:12345-0@lo:400:kworker.0 Request processed in 47us (1411us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401043.703129:0:14877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786401043.703141:0:14877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1786401043.703145:0:14877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1873176872188800:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1786401043.703171:0:14877:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 496 last 0 00000020:00000080:1.0:1786401043.703197:0:14877:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5ccaaf4f3cb1eb93 00002000:00100000:1.0:1786401043.703211:0:14877:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9d6fc6cc5800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1786401043.703216:0:14877:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1786401043.703219:0:14877:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:2.0:1786401043.703414:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1786401043.703722:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff6fe3b80 x1873176872189056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786401059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786401043.703746:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873176872189056:0@lo:400:kworker.0 00010000:00080000:0.0:1786401043.703761:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff6fe0380 x1873176872188928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786401059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786401043.703770:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873176872188928:0@lo:400:kworker.0 00000100:00100000:0.0:1786401043.703802:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:054a13af-ec40-49d6-93c2-21045d196afe:3307:1873176872188544:0@lo:400:kworker.0 00010000:00080000:0.0:1786401043.703813:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff6fe1880 x1873176872189184/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1786401059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1786401043.703823:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1873176872189184:0@lo:400:kworker.0 00000100:00100000:0.0:1786401043.703834:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872188672:0@lo:400:kworker.0 00002000:00080000:0.0:1786401043.704790:0:14877:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1786401043.704829:0:14877:0:(import.c:65:import_set_state_nolock()) ffff9d6ec470b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786401043.704912:0:14877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1873176872188800:12345-0@lo:8:kworker.0 Request processed in 1764us (3014us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401043.704922:0:14877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1786401043.705568:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff6fe2a00 x1873176872188800/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1786401068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1786401043.705589:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1786401043.705600:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1786401043.705606:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1786401043.705621:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9d70004f1800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1786401043.705647:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1786401043.705653:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1873176872188800:0@lo:8:kworker.0 00000004:00080000:2.0:1786401043.705764:0:14266:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:2.0:1786401043.705785:0:14266:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde21180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14266:1873176872189440:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1786401043.705831:0:14266:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786401043.705852:0:14266:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fe13c6300 going to sleep for 11 seconds 00000100:00100000:2.0:1786401043.705862:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786401043.705870:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872189312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786401043.705911:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786401043.705940:0:14878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872189440 00000100:00100000:2.0:1786401043.705946:0:14878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872189440 00000100:00100000:2.0:1786401043.705989:0:14878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1786401043.705997:0:14878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14266:x1873176872189440:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1786401043.707158:0:14265:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1786401043.707525:0:14265:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 496108437554ns, next at 0ns, rc = 0 00002000:00080000:2.0:1786401043.714489:0:14878:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1786401043.714504:0:14878:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1786401043.714511:0:14878:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00000100:00100000:2.0:1786401043.732830:0:14881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872189312 00000100:00100000:2.0:1786401043.732847:0:14881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872189312 00000100:00100000:2.0:1786401043.732905:0:14881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1786401043.732915:0:14881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1873176872189312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1786401043.732951:0:14881:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786401043.733302:0:14881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1873176872189312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 387us (27388us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401043.733311:0:14881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1786401043.733418:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1786401043.733455:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ffde21c00 x1873176872189312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1786401059 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1786401043.733477:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872189312:0@lo:13:osp-pre-1-0.0 00002000:00010000:2.0:1786401043.733908:0:14878:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786401043.733917:0:14878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d15db91/0x5ccaaf4f3cb1eb9a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.733933:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=496s v=(0 0) 00010000:00010000:2.0:1786401043.733938:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786401043.733944:0:14878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d15db91/0x5ccaaf4f3cb1eb9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.733961:0:14878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d15db91/0x5ccaaf4f3cb1eb9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.733972:0:14878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d15db91/0x5ccaaf4f3cb1eb9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.733980:0:14878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d15db91/0x5ccaaf4f3cb1eb9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.734000:0:14878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1786401043.734548:0:14878:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786401043.734555:0:14878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010665dfa/0x5ccaaf4f3cb1eba1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.734564:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=496s v=(0 0) 00010000:00010000:2.0:1786401043.734567:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786401043.734571:0:14878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010665dfa/0x5ccaaf4f3cb1eba1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.734593:0:14878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010665dfa/0x5ccaaf4f3cb1eba1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.734602:0:14878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010665dfa/0x5ccaaf4f3cb1eba1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.734610:0:14878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010665dfa/0x5ccaaf4f3cb1eba1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.734627:0:14878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1786401043.735037:0:14878:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786401043.735043:0:14878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016ffdd2d/0x5ccaaf4f3cb1eba8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.735064:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=496s v=(0 0) 00010000:00010000:2.0:1786401043.735068:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786401043.735072:0:14878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016ffdd2d/0x5ccaaf4f3cb1eba8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.735081:0:14878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016ffdd2d/0x5ccaaf4f3cb1eba8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.735113:0:14878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016ffdd2d/0x5ccaaf4f3cb1eba8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.735132:0:14878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016ffdd2d/0x5ccaaf4f3cb1eba8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.735148:0:14878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1786401043.738306:0:14878:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786401043.738319:0:14878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005730ae88/0x5ccaaf4f3cb1ebaf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.738635:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=496s v=(0 0) 00010000:00010000:2.0:1786401043.738640:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786401043.738647:0:14878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005730ae88/0x5ccaaf4f3cb1ebaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.738663:0:14878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005730ae88/0x5ccaaf4f3cb1ebaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.738673:0:14878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005730ae88/0x5ccaaf4f3cb1ebaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.738682:0:14878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005730ae88/0x5ccaaf4f3cb1ebaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.738695:0:14878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1786401043.739246:0:14878:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786401043.739252:0:14878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f17fff08/0x5ccaaf4f3cb1ebb6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.739266:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=496s v=(0 0) 00010000:00010000:2.0:1786401043.739269:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786401043.739273:0:14878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f17fff08/0x5ccaaf4f3cb1ebb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.739283:0:14878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f17fff08/0x5ccaaf4f3cb1ebb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.739291:0:14878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f17fff08/0x5ccaaf4f3cb1ebb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.739298:0:14878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f17fff08/0x5ccaaf4f3cb1ebb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.739307:0:14878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1786401043.739658:0:15374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1786401043.739668:0:15374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d15db91/0x5ccaaf4f3cb1eb9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.739679:0:15374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1ba000 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:1.0:1786401043.739685:0:15374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d15db91/0x5ccaaf4f3cb1eb9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.739695:0:15374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d15db91/0x5ccaaf4f3cb1eb9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.739715:0:15374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d15db91/0x5ccaaf4f3cb1eb9a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.739723:0:15374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d15db91/0x5ccaaf4f3cb1eb9a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.739746:0:15374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1786401043.739750:0:15374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010665dfa/0x5ccaaf4f3cb1eba1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.739758:0:15374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1bae00 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:1.0:1786401043.739761:0:15374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010665dfa/0x5ccaaf4f3cb1eba1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.739782:0:15374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010665dfa/0x5ccaaf4f3cb1eba1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.739794:0:15374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010665dfa/0x5ccaaf4f3cb1eba1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.739801:0:15374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010665dfa/0x5ccaaf4f3cb1eba1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.739818:0:15374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1786401043.739822:0:15374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016ffdd2d/0x5ccaaf4f3cb1eba8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.739829:0:15374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1bb400 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:1.0:1786401043.739833:0:15374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016ffdd2d/0x5ccaaf4f3cb1eba8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.739841:0:15374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016ffdd2d/0x5ccaaf4f3cb1eba8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.739850:0:15374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016ffdd2d/0x5ccaaf4f3cb1eba8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.739858:0:15374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016ffdd2d/0x5ccaaf4f3cb1eba8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786401043.739874:0:14878:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786401043.739882:0:14878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b022b692/0x5ccaaf4f3cb1ebbd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.739882:0:15374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786401043.739888:0:15374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005730ae88/0x5ccaaf4f3cb1ebaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.739895:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=496s v=(0 0) 00010000:00010000:2.0:1786401043.739903:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786401043.739903:0:15374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1ba200 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:1.0:1786401043.739910:0:15374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005730ae88/0x5ccaaf4f3cb1ebaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.739911:0:14878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b022b692/0x5ccaaf4f3cb1ebbd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.739929:0:15374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005730ae88/0x5ccaaf4f3cb1ebaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.739932:0:14878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b022b692/0x5ccaaf4f3cb1ebbd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.739954:0:14878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b022b692/0x5ccaaf4f3cb1ebbd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.739962:0:14878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b022b692/0x5ccaaf4f3cb1ebbd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.739972:0:14878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1786401043.740520:0:14878:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786401043.740531:0:14878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d0f1cfb/0x5ccaaf4f3cb1ebc4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.740537:0:15374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005730ae88/0x5ccaaf4f3cb1ebaf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.740540:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=496s v=(0 0) 00010000:00010000:2.0:1786401043.740544:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786401043.740548:0:14878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d0f1cfb/0x5ccaaf4f3cb1ebc4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.740570:0:15374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005730ae88/0x5ccaaf4f3cb1ebaf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.740573:0:14878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d0f1cfb/0x5ccaaf4f3cb1ebc4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.740591:0:14878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d0f1cfb/0x5ccaaf4f3cb1ebc4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.740597:0:15374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786401043.740600:0:14878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d0f1cfb/0x5ccaaf4f3cb1ebc4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.740604:0:15374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f17fff08/0x5ccaaf4f3cb1ebb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.740618:0:15374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1bb600 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:1.0:1786401043.740622:0:15374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f17fff08/0x5ccaaf4f3cb1ebb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.740641:0:14878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1786401043.740654:0:15374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f17fff08/0x5ccaaf4f3cb1ebb6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.740667:0:15374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f17fff08/0x5ccaaf4f3cb1ebb6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.740674:0:15374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f17fff08/0x5ccaaf4f3cb1ebb6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.740690:0:15374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1786401043.740694:0:15374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b022b692/0x5ccaaf4f3cb1ebbd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.740701:0:15374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1baa00 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:1.0:1786401043.740705:0:15374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b022b692/0x5ccaaf4f3cb1ebbd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.740712:0:15374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b022b692/0x5ccaaf4f3cb1ebbd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.740724:0:15374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b022b692/0x5ccaaf4f3cb1ebbd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.740732:0:15374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b022b692/0x5ccaaf4f3cb1ebbd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.740759:0:15374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786401043.740763:0:15374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d0f1cfb/0x5ccaaf4f3cb1ebc4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.740770:0:15374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1bb200 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:1.0:1786401043.740774:0:15374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d0f1cfb/0x5ccaaf4f3cb1ebc4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.740782:0:15374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d0f1cfb/0x5ccaaf4f3cb1ebc4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.740793:0:15374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d0f1cfb/0x5ccaaf4f3cb1ebc4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.740801:0:15374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d0f1cfb/0x5ccaaf4f3cb1ebc4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.740813:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786401043.740815:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786401043.740817:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786401043.740830:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786401043.740836:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786401043.741461:0:14878:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786401043.741469:0:14878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4c03134/0x5ccaaf4f3cb1ebcb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.741479:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=496s v=(0 0) 00010000:00010000:2.0:1786401043.741482:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786401043.741487:0:14878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4c03134/0x5ccaaf4f3cb1ebcb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.741497:0:14878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4c03134/0x5ccaaf4f3cb1ebcb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.741505:0:14878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4c03134/0x5ccaaf4f3cb1ebcb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.741512:0:14878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4c03134/0x5ccaaf4f3cb1ebcb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.741530:0:14878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786401043.741736:0:15374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786401043.741743:0:15374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4c03134/0x5ccaaf4f3cb1ebcb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.741764:0:15374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1ba400 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:1.0:1786401043.741768:0:15374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4c03134/0x5ccaaf4f3cb1ebcb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.741776:0:15374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4c03134/0x5ccaaf4f3cb1ebcb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.741789:0:15374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4c03134/0x5ccaaf4f3cb1ebcb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.741797:0:15374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4c03134/0x5ccaaf4f3cb1ebcb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.741813:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786401043.741815:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786401043.741817:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786401043.742186:0:14878:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786401043.742192:0:14878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f120f27d/0x5ccaaf4f3cb1ebd2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.742201:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=496s v=(0 0) 00010000:00010000:2.0:1786401043.742210:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786401043.742215:0:14878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f120f27d/0x5ccaaf4f3cb1ebd2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.742225:0:14878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f120f27d/0x5ccaaf4f3cb1ebd2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.742233:0:14878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f120f27d/0x5ccaaf4f3cb1ebd2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.742240:0:14878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f120f27d/0x5ccaaf4f3cb1ebd2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.742255:0:14878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786401043.743929:0:14229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786401043.743941:0:14229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f120f27d/0x5ccaaf4f3cb1ebd2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786401043.744317:0:14878:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786401043.744398:0:14878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099da9237/0x5ccaaf4f3cb1ebd9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.744414:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=496s v=(0 0) 00010000:00010000:2.0:1786401043.744418:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786401043.744424:0:14878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099da9237/0x5ccaaf4f3cb1ebd9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.744437:0:14878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099da9237/0x5ccaaf4f3cb1ebd9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.744447:0:14878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099da9237/0x5ccaaf4f3cb1ebd9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.744461:0:14878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099da9237/0x5ccaaf4f3cb1ebd9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.744490:0:14878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786401043.744774:0:14229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1bba00 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:1.0:1786401043.744780:0:14229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f120f27d/0x5ccaaf4f3cb1ebd2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.744791:0:14229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f120f27d/0x5ccaaf4f3cb1ebd2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.744813:0:14229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f120f27d/0x5ccaaf4f3cb1ebd2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.744821:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f120f27d/0x5ccaaf4f3cb1ebd2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.744840:0:14229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786401043.744844:0:14229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099da9237/0x5ccaaf4f3cb1ebd9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.744851:0:14229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5da00 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:1.0:1786401043.744855:0:14229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099da9237/0x5ccaaf4f3cb1ebd9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.744863:0:14229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099da9237/0x5ccaaf4f3cb1ebd9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.744873:0:14229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099da9237/0x5ccaaf4f3cb1ebd9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.744880:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099da9237/0x5ccaaf4f3cb1ebd9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.744891:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786401043.744893:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786401043.744900:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786401043.745270:0:14878:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786401043.745277:0:14878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042039024/0x5ccaaf4f3cb1ebe0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.745287:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=496s v=(0 0) 00010000:00010000:2.0:1786401043.745292:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786401043.745296:0:14878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042039024/0x5ccaaf4f3cb1ebe0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.745306:0:14878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042039024/0x5ccaaf4f3cb1ebe0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.745315:0:14878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042039024/0x5ccaaf4f3cb1ebe0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.745322:0:14878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042039024/0x5ccaaf4f3cb1ebe0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.745410:0:14878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1786401043.745961:0:14230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786401043.745969:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042039024/0x5ccaaf4f3cb1ebe0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401043.745978:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5c600 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:0.0:1786401043.745983:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042039024/0x5ccaaf4f3cb1ebe0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401043.746005:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042039024/0x5ccaaf4f3cb1ebe0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401043.746022:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042039024/0x5ccaaf4f3cb1ebe0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401043.746030:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042039024/0x5ccaaf4f3cb1ebe0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401043.746060:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786401043.746062:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786401043.746064:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786401043.746500:0:14878:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786401043.746508:0:14878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec9d3286/0x5ccaaf4f3cb1ebe7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.746523:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=496s v=(0 0) 00010000:00010000:2.0:1786401043.746527:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786401043.746532:0:14878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec9d3286/0x5ccaaf4f3cb1ebe7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.746542:0:14878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec9d3286/0x5ccaaf4f3cb1ebe7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.746551:0:14878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec9d3286/0x5ccaaf4f3cb1ebe7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.746559:0:14878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec9d3286/0x5ccaaf4f3cb1ebe7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.746673:0:14878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1786401043.747194:0:14878:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786401043.747200:0:14878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ec6f6bb/0x5ccaaf4f3cb1ebee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.747210:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=496s v=(0 0) 00010000:00010000:2.0:1786401043.747213:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786401043.747218:0:14878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ec6f6bb/0x5ccaaf4f3cb1ebee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.747228:0:14878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ec6f6bb/0x5ccaaf4f3cb1ebee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.747248:0:14878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ec6f6bb/0x5ccaaf4f3cb1ebee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.747255:0:14878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ec6f6bb/0x5ccaaf4f3cb1ebee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401043.748666:0:14229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786401043.748679:0:14229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec9d3286/0x5ccaaf4f3cb1ebe7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401043.748690:0:14229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5ca00 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:0.0:1786401043.748696:0:14229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec9d3286/0x5ccaaf4f3cb1ebe7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401043.748706:0:14229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec9d3286/0x5ccaaf4f3cb1ebe7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401043.748724:0:14229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec9d3286/0x5ccaaf4f3cb1ebe7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401043.748749:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec9d3286/0x5ccaaf4f3cb1ebe7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401043.748784:0:14229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786401043.748788:0:14229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ec6f6bb/0x5ccaaf4f3cb1ebee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401043.748795:0:14229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5ce00 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:0.0:1786401043.748798:0:14229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ec6f6bb/0x5ccaaf4f3cb1ebee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401043.748805:0:14229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ec6f6bb/0x5ccaaf4f3cb1ebee lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401043.748817:0:14229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ec6f6bb/0x5ccaaf4f3cb1ebee lrc: 2/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401043.748825:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786401043.748827:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786401043.748829:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786401043.753335:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786401043.758670:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401043.762061:0:14878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1786401043.762077:0:14878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ec6f6bb/0x5ccaaf4f3cb1ebee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1786401043.762757:0:14878:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786401043.762779:0:14878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef8bb29b/0x5ccaaf4f3cb1ebf5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.762793:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=496s v=(0 0) 00010000:00010000:2.0:1786401043.762798:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786401043.762804:0:14878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef8bb29b/0x5ccaaf4f3cb1ebf5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.762817:0:14878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef8bb29b/0x5ccaaf4f3cb1ebf5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.762828:0:14878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef8bb29b/0x5ccaaf4f3cb1ebf5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.762848:0:14878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef8bb29b/0x5ccaaf4f3cb1ebf5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.762876:0:14878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1786401043.763617:0:14878:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786401043.763626:0:14878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019789f04/0x5ccaaf4f3cb1ebfc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.763636:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=496s v=(0 0) 00010000:00010000:2.0:1786401043.763639:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786401043.763643:0:14878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019789f04/0x5ccaaf4f3cb1ebfc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.763654:0:14878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019789f04/0x5ccaaf4f3cb1ebfc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.763663:0:14878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019789f04/0x5ccaaf4f3cb1ebfc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.763669:0:14878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019789f04/0x5ccaaf4f3cb1ebfc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.763687:0:14878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1786401043.764185:0:14878:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786401043.764191:0:14878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9c4f847/0x5ccaaf4f3cb1ec03 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.764206:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=496s v=(0 0) 00010000:00010000:2.0:1786401043.764209:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786401043.764213:0:14878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9c4f847/0x5ccaaf4f3cb1ec03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.764221:0:14878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9c4f847/0x5ccaaf4f3cb1ec03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.764228:0:14878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9c4f847/0x5ccaaf4f3cb1ec03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.764236:0:14878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9c4f847/0x5ccaaf4f3cb1ec03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.764252:0:14878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1786401043.764266:0:14230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1786401043.764272:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef8bb29b/0x5ccaaf4f3cb1ebf5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.764278:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5c400 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:2.0:1786401043.764283:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef8bb29b/0x5ccaaf4f3cb1ebf5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.764291:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef8bb29b/0x5ccaaf4f3cb1ebf5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.764316:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef8bb29b/0x5ccaaf4f3cb1ebf5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.764323:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef8bb29b/0x5ccaaf4f3cb1ebf5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.764342:0:14230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1786401043.764345:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019789f04/0x5ccaaf4f3cb1ebfc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.764351:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5d200 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:2.0:1786401043.764354:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019789f04/0x5ccaaf4f3cb1ebfc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.764362:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019789f04/0x5ccaaf4f3cb1ebfc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.764372:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019789f04/0x5ccaaf4f3cb1ebfc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.764379:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019789f04/0x5ccaaf4f3cb1ebfc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.764390:0:14230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786401043.764393:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9c4f847/0x5ccaaf4f3cb1ec03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.764405:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5d800 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:2.0:1786401043.764407:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9c4f847/0x5ccaaf4f3cb1ec03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.764414:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9c4f847/0x5ccaaf4f3cb1ec03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.764422:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9c4f847/0x5ccaaf4f3cb1ec03 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.764429:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9c4f847/0x5ccaaf4f3cb1ec03 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.764439:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401043.764441:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401043.764442:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786401043.764963:0:14878:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786401043.764970:0:14878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091d16b46/0x5ccaaf4f3cb1ec0a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.764979:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=496s v=(0 0) 00010000:00010000:2.0:1786401043.764983:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786401043.764987:0:14878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091d16b46/0x5ccaaf4f3cb1ec0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.764997:0:14878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091d16b46/0x5ccaaf4f3cb1ec0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.765012:0:14878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091d16b46/0x5ccaaf4f3cb1ec0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.765019:0:14878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091d16b46/0x5ccaaf4f3cb1ec0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.765035:0:14878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786401043.765054:0:14230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786401043.765059:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091d16b46/0x5ccaaf4f3cb1ec0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.765066:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5c200 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:2.0:1786401043.765069:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091d16b46/0x5ccaaf4f3cb1ec0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.765077:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091d16b46/0x5ccaaf4f3cb1ec0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.765124:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091d16b46/0x5ccaaf4f3cb1ec0a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.765132:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091d16b46/0x5ccaaf4f3cb1ec0a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.765146:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401043.765154:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401043.765156:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786401043.767553:0:14878:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786401043.767564:0:14878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c097392d/0x5ccaaf4f3cb1ec11 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.767580:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=496s v=(0 0) 00010000:00010000:2.0:1786401043.767584:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786401043.767589:0:14878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c097392d/0x5ccaaf4f3cb1ec11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.767604:0:14878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c097392d/0x5ccaaf4f3cb1ec11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.767614:0:14878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c097392d/0x5ccaaf4f3cb1ec11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.767622:0:14878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c097392d/0x5ccaaf4f3cb1ec11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.767638:0:14878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786401043.767652:0:14230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786401043.767657:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c097392d/0x5ccaaf4f3cb1ec11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.767664:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5dc00 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:2.0:1786401043.767669:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c097392d/0x5ccaaf4f3cb1ec11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.767689:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c097392d/0x5ccaaf4f3cb1ec11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.767704:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c097392d/0x5ccaaf4f3cb1ec11 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.767710:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c097392d/0x5ccaaf4f3cb1ec11 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.767729:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401043.767731:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401043.767733:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786401043.770132:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786401043.770730:0:14878:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786401043.770740:0:14878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a88933f8/0x5ccaaf4f3cb1ec18 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.770756:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=496s v=(0 0) 00010000:00010000:2.0:1786401043.770761:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786401043.771457:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401043.776920:0:14878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a88933f8/0x5ccaaf4f3cb1ec18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.776948:0:14878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a88933f8/0x5ccaaf4f3cb1ec18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.776961:0:14878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a88933f8/0x5ccaaf4f3cb1ec18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.776977:0:14878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a88933f8/0x5ccaaf4f3cb1ec18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.777003:0:14878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786401043.777020:0:14230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786401043.777026:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a88933f8/0x5ccaaf4f3cb1ec18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.777034:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5de00 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:2.0:1786401043.777039:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a88933f8/0x5ccaaf4f3cb1ec18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.777061:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a88933f8/0x5ccaaf4f3cb1ec18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.777080:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a88933f8/0x5ccaaf4f3cb1ec18 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.777102:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a88933f8/0x5ccaaf4f3cb1ec18 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.777131:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401043.777133:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401043.777135:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786401043.777754:0:14878:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786401043.785270:0:14878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c944dc6/0x5ccaaf4f3cb1ec1f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.785288:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=496s v=(0 0) 00010000:00010000:2.0:1786401043.785292:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786401043.785298:0:14878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c944dc6/0x5ccaaf4f3cb1ec1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.785314:0:14878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c944dc6/0x5ccaaf4f3cb1ec1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.785325:0:14878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c944dc6/0x5ccaaf4f3cb1ec1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.785332:0:14878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c944dc6/0x5ccaaf4f3cb1ec1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.785365:0:14878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786401043.787138:0:14229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786401043.787150:0:14229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c944dc6/0x5ccaaf4f3cb1ec1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401043.787162:0:14229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5c800 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:3.0:1786401043.787167:0:14229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c944dc6/0x5ccaaf4f3cb1ec1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401043.787197:0:14229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c944dc6/0x5ccaaf4f3cb1ec1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401043.787218:0:14229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c944dc6/0x5ccaaf4f3cb1ec1f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401043.787225:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c944dc6/0x5ccaaf4f3cb1ec1f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401043.787247:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786401043.787248:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786401043.787250:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1786401043.792913:0:14878:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786401043.792929:0:14878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9c4f847/0x5ccaaf4f3cb1ec26 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.792949:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=496s v=(0 0) 00010000:00010000:2.0:1786401043.792953:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786401043.792961:0:14878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9c4f847/0x5ccaaf4f3cb1ec26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.792976:0:14878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9c4f847/0x5ccaaf4f3cb1ec26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.792994:0:14878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9c4f847/0x5ccaaf4f3cb1ec26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.793002:0:14878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9c4f847/0x5ccaaf4f3cb1ec26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.793027:0:14878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786401043.793064:0:15374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786401043.793071:0:15374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9c4f847/0x5ccaaf4f3cb1ec26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.793079:0:15374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5d800 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:2.0:1786401043.793083:0:15374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9c4f847/0x5ccaaf4f3cb1ec26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.793111:0:15374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9c4f847/0x5ccaaf4f3cb1ec26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.793129:0:15374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9c4f847/0x5ccaaf4f3cb1ec26 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.793138:0:15374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9c4f847/0x5ccaaf4f3cb1ec26 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.796722:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401043.796739:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401043.796742:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786401043.799921:0:14878:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786401043.799935:0:14878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ef923fa/0x5ccaaf4f3cb1ec2d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401043.799954:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=496s v=(0 0) 00010000:00010000:3.0:1786401043.799958:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786401043.799966:0:14878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ef923fa/0x5ccaaf4f3cb1ec2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401043.799982:0:14878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ef923fa/0x5ccaaf4f3cb1ec2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401043.799992:0:14878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ef923fa/0x5ccaaf4f3cb1ec2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401043.800019:0:14878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ef923fa/0x5ccaaf4f3cb1ec2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401043.800041:0:14878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786401043.804222:0:14230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786401043.804237:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ef923fa/0x5ccaaf4f3cb1ec2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.804252:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca090a00 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:2.0:1786401043.804258:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ef923fa/0x5ccaaf4f3cb1ec2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.804269:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ef923fa/0x5ccaaf4f3cb1ec2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.804291:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ef923fa/0x5ccaaf4f3cb1ec2d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.804300:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ef923fa/0x5ccaaf4f3cb1ec2d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.804324:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401043.804326:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401043.804328:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786401043.832053:0:14878:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786401043.832068:0:14878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1ec34 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401043.832099:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=496s v=(0 0) 00010000:00010000:3.0:1786401043.832105:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786401043.832113:0:14878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1ec34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401043.832128:0:14878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1ec34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401043.832137:0:14878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1ec34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401043.832144:0:14878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1ec34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401043.832165:0:14878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786401043.832177:0:14229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786401043.832182:0:14229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1ec34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401043.832196:0:14229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca091600 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:3.0:1786401043.832201:0:14229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1ec34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401043.832210:0:14229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1ec34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401043.832228:0:14229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1ec34 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401043.832235:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1ec34 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401043.832256:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786401043.832257:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786401043.832259:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1786401043.840671:0:7501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:2.0:1786401043.841843:0:14878:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786401043.841858:0:14878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005659cb11/0x5ccaaf4f3cb1ec3b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.841877:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=496s v=(0 0) 00010000:00010000:2.0:1786401043.841890:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786401043.841897:0:14878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005659cb11/0x5ccaaf4f3cb1ec3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.841914:0:14878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005659cb11/0x5ccaaf4f3cb1ec3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.841925:0:14878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005659cb11/0x5ccaaf4f3cb1ec3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.841933:0:14878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005659cb11/0x5ccaaf4f3cb1ec3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.841958:0:14878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1786401043.842702:0:15374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786401043.842723:0:15374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005659cb11/0x5ccaaf4f3cb1ec3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.842735:0:15374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca091200 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:1.0:1786401043.842740:0:15374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005659cb11/0x5ccaaf4f3cb1ec3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.842750:0:15374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005659cb11/0x5ccaaf4f3cb1ec3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.842770:0:15374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005659cb11/0x5ccaaf4f3cb1ec3b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.842777:0:15374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005659cb11/0x5ccaaf4f3cb1ec3b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.842800:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786401043.842801:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786401043.842803:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786401043.846069:0:14878:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786401043.846083:0:14878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1ec42 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401043.846118:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=496s v=(0 0) 00010000:00010000:3.0:1786401043.846123:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786401043.846129:0:14878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1ec42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401043.846144:0:14878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1ec42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401043.846160:0:14878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1ec42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401043.846168:0:14878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1ec42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401043.846184:0:14878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1786401043.846413:0:14230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1786401043.846421:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1ec42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.846431:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca090e00 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:2.0:1786401043.846437:0:14230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1ec42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.846448:0:14230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1ec42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.846466:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1ec42 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.846485:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0d15439/0x5ccaaf4f3cb1ec42 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.846504:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401043.846505:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401043.846507:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1786401043.851905:0:5810:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:2.0:1786401043.853141:0:14878:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1786401043.853153:0:14878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9c4f847/0x5ccaaf4f3cb1ec49 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.853170:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=496s v=(0 0) 00010000:00010000:2.0:1786401043.853175:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786401043.853181:0:14878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9c4f847/0x5ccaaf4f3cb1ec49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.853196:0:14878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9c4f847/0x5ccaaf4f3cb1ec49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.853206:0:14878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9c4f847/0x5ccaaf4f3cb1ec49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.853214:0:14878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9c4f847/0x5ccaaf4f3cb1ec49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401043.853231:0:14878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1786401043.855238:0:14229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1786401043.855251:0:14229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9c4f847/0x5ccaaf4f3cb1ec49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401043.855264:0:14229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5d800 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:3.0:1786401043.855270:0:14229:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9c4f847/0x5ccaaf4f3cb1ec49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401043.855280:0:14229:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9c4f847/0x5ccaaf4f3cb1ec49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401043.855609:0:14229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9c4f847/0x5ccaaf4f3cb1ec49 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401043.855620:0:14229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9c4f847/0x5ccaaf4f3cb1ec49 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401043.855668:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786401043.855670:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1786401043.855671:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1786401043.862817:0:14878:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1786401043.862833:0:14878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1ec50 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401043.862853:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=496s v=(0 0) 00010000:00010000:3.0:1786401043.862870:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786401043.862877:0:14878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1ec50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401043.862894:0:14878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1ec50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401043.862906:0:14878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1ec50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401043.862913:0:14878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1ec50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401043.862945:0:14878:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1786401043.863214:0:14878:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00010000:00010000:1.0:1786401043.864793:0:15374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1786401043.864805:0:15374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1ec50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.864818:0:15374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca091600 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:1.0:1786401043.864831:0:15374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1ec50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.864841:0:15374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1ec50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.864877:0:15374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1ec50 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.865173:0:15374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090c47888/0x5ccaaf4f3cb1ec50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401043.865198:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786401043.865200:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786401043.865202:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786401043.868065:0:14878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:14266:x1873176872189440:12345-0@lo:5:osp-pre-1-0.0 Request processed in 162058us (162223us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401043.868081:0:14878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1786401043.873776:0:14266:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde21180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14266:1873176872189440:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1786401043.873804:0:14266:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:2.0:1786401043.873851:0:14266:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde21180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14266:1873176872189568:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1786401043.873919:0:14266:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786401043.873972:0:14266:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff6ec9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1786401043.881541:0:14877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872189568 00000100:00100000:0.0:1786401043.881558:0:14877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872189568 00000100:00100000:0.0:1786401043.881635:0:14877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1786401043.881647:0:14877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:14266:x1873176872189568:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1786401043.881708:0:14877:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1786401043.902851:0:14877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14266:x1873176872189568:12345-0@lo:5:osp-pre-1-0.0 Request processed in 21198us (28923us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1786401043.902866:0:14877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1786401043.903201:0:14266:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde21180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14266:1873176872189568:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1786401043.903217:0:14266:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:2.0:1786401044.142512:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786401044.206362:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd893800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872189696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786401044.206506:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401044.206670:0:14881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872189696 00000100:00100000:1.0:1786401044.206679:0:14881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872189696 00000100:00100000:1.0:1786401044.206736:0:14881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1786401044.206745:0:14881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872189696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786401044.206790:0:14881:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786401044.206836:0:14881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872189696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401044.206843:0:14881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1786401044.206890:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd893800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872189696:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1786401045.169437:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1786401045.226686:0:15900:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg408-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1786401046.190543:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401047.215394:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786401047.632848:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401047.632918:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850178432 00000100:00100000:3.0:1786401047.632932:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850178432 00000100:00100000:3.0:1786401047.632997:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 74 00000100:00100000:3.0:1786401047.633007:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef699850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2361:x1873176850178432:12345-192.168.204.8@tcp:250:mount.lustre.0 00010000:00080000:3.0:1786401047.633045:0:14235:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from a470e8d0-b507-45e2-885f-f3cf1de83cf7@192.168.204.8@tcp t0 exp 0000000000000000 cur 500 last 0 00000020:00000080:3.0:1786401047.633125:0:14235:0:(genops.c:1406:class_connect()) connect: client a470e8d0-b507-45e2-885f-f3cf1de83cf7, cookie 0x5ccaaf4f3cb1ec57 00000100:00080000:3.0:1786401047.633307:0:14235:0:(import.c:65:import_set_state_nolock()) ffff9d6fc49f2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786401047.633403:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef699850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a470e8d0-b507-45e2-885f-f3cf1de83cf7+5:2361:x1873176850178432:12345-192.168.204.8@tcp:250:mount.lustre.0 Request processed in 395us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401047.633413:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 74 00000100:00100000:2.0:1786401047.653175:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401047.653583:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850178560 00000100:00100000:3.0:1786401047.653598:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850178560 00000100:00100000:3.0:1786401047.653674:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 75 00000100:00100000:3.0:1786401047.653686:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef69a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a470e8d0-b507-45e2-885f-f3cf1de83cf7+5:13717:x1873176850178560:12345-192.168.204.8@tcp:101:mount.lustre.0 00010000:00010000:3.0:1786401047.653710:0:14236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786401047.653734:0:14236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fca090c00/0x5ccaaf4f3cb1ec5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6befa expref: -99 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401047.653775:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fca090c00/0x5ccaaf4f3cb1ec5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6befa expref: 6 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401047.653788:0:14236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fca090c00/0x5ccaaf4f3cb1ec5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6befa expref: 6 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401047.653799:0:14236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca090c00, rc 0) 00000100:00100000:3.0:1786401047.653884:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef69a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a470e8d0-b507-45e2-885f-f3cf1de83cf7+6:13717:x1873176850178560:12345-192.168.204.8@tcp:101:mount.lustre.0 Request processed in 200us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401047.653913:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 75 00000100:00100000:1.0:1786401047.668018:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401047.668361:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850178688 00000100:00100000:3.0:1786401047.668375:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850178688 00000100:00100000:3.0:1786401047.668450:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 76 00000100:00100000:3.0:1786401047.668462:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef698450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a470e8d0-b507-45e2-885f-f3cf1de83cf7+6:13717:x1873176850178688:12345-192.168.204.8@tcp:501:mount.lustre.0 00000100:00100000:3.0:1786401047.669920:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef698450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a470e8d0-b507-45e2-885f-f3cf1de83cf7+6:13717:x1873176850178688:12345-192.168.204.8@tcp:501:mount.lustre.0 Request processed in 1447us (1905us total) trans 0 rc -2/-2 00000100:00100000:3.0:1786401047.669938:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 76 00000100:00100000:1.0:1786401047.673017:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401047.673480:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850178816 00000100:00100000:3.0:1786401047.673496:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850178816 00000100:00100000:3.0:1786401047.673580:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 77 00000100:00100000:3.0:1786401047.673591:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef69bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a470e8d0-b507-45e2-885f-f3cf1de83cf7+6:13717:x1873176850178816:12345-192.168.204.8@tcp:101:mount.lustre.0 00010000:00010000:3.0:1786401047.673613:0:14236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786401047.673639:0:14236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fca090200/0x5ccaaf4f3cb1ec65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bf01 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401047.673677:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fca090200/0x5ccaaf4f3cb1ec65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bf01 expref: 7 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401047.673691:0:14236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fca090200/0x5ccaaf4f3cb1ec65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bf01 expref: 7 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401047.673701:0:14236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca090200, rc 0) 00000100:00100000:3.0:1786401047.673778:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef69bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a470e8d0-b507-45e2-885f-f3cf1de83cf7+7:13717:x1873176850178816:12345-192.168.204.8@tcp:101:mount.lustre.0 Request processed in 188us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401047.673786:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 77 00000100:00100000:2.0:1786401047.677184:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401047.677322:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850178944 00000100:00100000:3.0:1786401047.677336:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850178944 00000100:00100000:3.0:1786401047.677409:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 78 00000100:00100000:3.0:1786401047.677421:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef69b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a470e8d0-b507-45e2-885f-f3cf1de83cf7+7:13717:x1873176850178944:12345-192.168.204.8@tcp:501:mount.lustre.0 00000100:00100000:3.0:1786401047.678082:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef69b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a470e8d0-b507-45e2-885f-f3cf1de83cf7+8:13717:x1873176850178944:12345-192.168.204.8@tcp:501:mount.lustre.0 Request processed in 658us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401047.678117:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 78 00000100:00100000:1.0:1786401047.680397:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786401047.680524:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850179072 00000100:00100000:2.0:1786401047.680538:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850179072 00000100:00100000:2.0:1786401047.680645:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 79 00000100:00100000:2.0:1786401047.680658:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef69a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a470e8d0-b507-45e2-885f-f3cf1de83cf7+8:13717:x1873176850179072:12345-192.168.204.8@tcp:503:mount.lustre.0 00000100:00100000:2.0:1786401047.681225:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef69a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a470e8d0-b507-45e2-885f-f3cf1de83cf7+8:13717:x1873176850179072:12345-192.168.204.8@tcp:503:mount.lustre.0 Request processed in 562us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401047.681235:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 79 00000100:00100000:1.0:1786401047.686703:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401047.687066:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850179200 00000100:00100000:3.0:1786401047.687082:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850179200 00000100:00100000:3.0:1786401047.687250:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 80 00000100:00100000:3.0:1786401047.687263:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef698c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a470e8d0-b507-45e2-885f-f3cf1de83cf7+8:13737:x1873176850179200:12345-192.168.204.8@tcp:502:llog_process_th.0 00000100:00100000:3.0:1786401047.688039:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef698c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a470e8d0-b507-45e2-885f-f3cf1de83cf7+8:13737:x1873176850179200:12345-192.168.204.8@tcp:502:llog_process_th.0 Request processed in 774us (1357us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401047.688051:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 80 00000100:00100000:0.0:1786401047.706403:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786401047.706530:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850179328 00000100:00100000:2.0:1786401047.706545:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850179328 00000100:00100000:2.0:1786401047.706625:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 81 00000100:00100000:2.0:1786401047.706639:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9784050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a470e8d0-b507-45e2-885f-f3cf1de83cf7+8:13737:x1873176850179328:12345-192.168.204.8@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786401047.707187:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9784050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a470e8d0-b507-45e2-885f-f3cf1de83cf7+8:13737:x1873176850179328:12345-192.168.204.8@tcp:502:llog_process_th.0 Request processed in 548us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401047.707199:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 81 00000100:00100000:1.0:1786401047.715554:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401047.715714:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850179456 00000100:00100000:3.0:1786401047.715728:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850179456 00000100:00100000:3.0:1786401047.715800:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 82 00000100:00100000:3.0:1786401047.715812:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9786050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a470e8d0-b507-45e2-885f-f3cf1de83cf7+8:13717:x1873176850179456:12345-192.168.204.8@tcp:101:mount.lustre.0 00010000:00010000:3.0:1786401047.716047:0:14235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786401047.716074:0:14235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fca091600/0x5ccaaf4f3cb1ec6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bf2b expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401047.716163:0:14235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fca091600/0x5ccaaf4f3cb1ec6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bf2b expref: 9 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401047.716176:0:14235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fca091600/0x5ccaaf4f3cb1ec6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bf2b expref: 9 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401047.716209:0:14235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca091600, rc 0) 00000100:00100000:3.0:1786401047.716273:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9786050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a470e8d0-b507-45e2-885f-f3cf1de83cf7+9:13717:x1873176850179456:12345-192.168.204.8@tcp:101:mount.lustre.0 Request processed in 463us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401047.716281:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 82 00000100:00100000:1.0:1786401047.721839:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786401047.721956:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850179584 00000100:00100000:2.0:1786401047.721987:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850179584 00000100:00100000:2.0:1786401047.722062:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 83 00000100:00100000:2.0:1786401047.722074:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9785450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a470e8d0-b507-45e2-885f-f3cf1de83cf7+9:13717:x1873176850179584:12345-192.168.204.8@tcp:256:mount.lustre.0 20000000:01000000:2.0:1786401047.722158:0:14233:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1786401047.722191:0:14233:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1786401047.722196:0:14233:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1786401047.722204:0:14233:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1786401047.722207:0:14233:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1786401047.726601:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9785450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a470e8d0-b507-45e2-885f-f3cf1de83cf7+9:13717:x1873176850179584:12345-192.168.204.8@tcp:256:mount.lustre.0 Request processed in 4506us (4768us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401047.726622:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 83 00000100:00100000:1.0:1786401047.733700:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401047.733824:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850179712 00000100:00100000:3.0:1786401047.733915:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850179712 00000100:00100000:3.0:1786401047.734050:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 84 00000100:00100000:3.0:1786401047.734063:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9785c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a470e8d0-b507-45e2-885f-f3cf1de83cf7+9:13717:x1873176850179712:12345-192.168.204.8@tcp:101:mount.lustre.0 00010000:00010000:3.0:1786401047.734135:0:14235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786401047.734165:0:14235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fca090e00/0x5ccaaf4f3cb1ec73 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bf32 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401047.734203:0:14235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fca090e00/0x5ccaaf4f3cb1ec73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bf32 expref: 10 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401047.734215:0:14235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fca090e00/0x5ccaaf4f3cb1ec73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bf32 expref: 10 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401047.734226:0:14235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca090e00, rc 0) 00000100:00100000:3.0:1786401047.734287:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9785c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a470e8d0-b507-45e2-885f-f3cf1de83cf7+10:13717:x1873176850179712:12345-192.168.204.8@tcp:101:mount.lustre.0 Request processed in 226us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401047.734293:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 84 00000100:00100000:1.0:1786401047.737370:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786401047.737518:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850179840 00000100:00100000:2.0:1786401047.737536:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850179840 00000100:00100000:2.0:1786401047.737651:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 85 00000100:00100000:2.0:1786401047.737663:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9787050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a470e8d0-b507-45e2-885f-f3cf1de83cf7+10:13717:x1873176850179840:12345-192.168.204.8@tcp:501:mount.lustre.0 00000100:00100000:2.0:1786401047.738435:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9787050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a470e8d0-b507-45e2-885f-f3cf1de83cf7+10:13717:x1873176850179840:12345-192.168.204.8@tcp:501:mount.lustre.0 Request processed in 770us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401047.738445:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 85 00000100:00100000:0.0:1786401047.740305:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401047.740588:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850179968 00000100:00100000:3.0:1786401047.740601:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850179968 00000100:00100000:3.0:1786401047.740717:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 86 00000100:00100000:3.0:1786401047.740731:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a470e8d0-b507-45e2-885f-f3cf1de83cf7+10:13717:x1873176850179968:12345-192.168.204.8@tcp:503:mount.lustre.0 00000100:00100000:3.0:1786401047.741278:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9784850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a470e8d0-b507-45e2-885f-f3cf1de83cf7+10:13717:x1873176850179968:12345-192.168.204.8@tcp:503:mount.lustre.0 Request processed in 547us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401047.741288:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 86 00000100:00100000:1.0:1786401047.743726:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786401047.743964:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850180096 00000100:00100000:2.0:1786401047.744072:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850180096 00000100:00100000:2.0:1786401047.744373:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 87 00000100:00100000:2.0:1786401047.744384:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9785850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a470e8d0-b507-45e2-885f-f3cf1de83cf7+10:13742:x1873176850180096:12345-192.168.204.8@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786401047.745184:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9785850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a470e8d0-b507-45e2-885f-f3cf1de83cf7+10:13742:x1873176850180096:12345-192.168.204.8@tcp:502:llog_process_th.0 Request processed in 797us (1468us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401047.745196:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 87 00000100:00100000:1.0:1786401047.753805:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401047.755197:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850180224 00000100:00100000:3.0:1786401047.755216:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850180224 00000100:00100000:2.0:1786401047.755775:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 88 00000100:00100000:2.0:1786401047.755790:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a470e8d0-b507-45e2-885f-f3cf1de83cf7+10:13742:x1873176850180224:12345-192.168.204.8@tcp:502:llog_process_th.0 00000100:00100000:2.0:1786401047.756176:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9786450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a470e8d0-b507-45e2-885f-f3cf1de83cf7+10:13742:x1873176850180224:12345-192.168.204.8@tcp:502:llog_process_th.0 Request processed in 388us (2385us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401047.756186:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 88 00000100:00100000:0.0:1786401047.772556:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786401047.773056:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850180352 00000100:00100000:2.0:1786401047.773071:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850180352 00000100:00100000:2.0:1786401047.773603:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4 00000100:00100000:2.0:1786401047.773616:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2361:x1873176850180352:12345-192.168.204.8@tcp:38:mount.lustre.0 00010000:00080000:2.0:1786401047.773656:0:14243:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from cedfe83e-8f3e-46c2-8429-f823952ad440@192.168.204.8@tcp t0 exp 0000000000000000 cur 500 last 0 00000020:00000080:2.0:1786401047.773739:0:14243:0:(genops.c:1406:class_connect()) connect: client cedfe83e-8f3e-46c2-8429-f823952ad440, cookie 0x5ccaaf4f3cb1ec7a 00000004:00100000:2.0:1786401047.773781:0:14243:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1786401047.773788:0:14243:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1786401047.826453:0:14243:0:(import.c:65:import_set_state_nolock()) ffff9d6fc49f3000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1786401047.826621:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+6:2361:x1873176850180352:12345-192.168.204.8@tcp:38:mount.lustre.0 Request processed in 53003us (54078us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401047.826635:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4 00000100:00100000:1.0:1786401047.831245:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786401047.831297:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401047.831334:0:14902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850180480 00000100:00100000:0.0:1786401047.831347:0:14902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850180480 00000100:00100000:2.0:1786401047.831431:0:14241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850180608 00000100:00100000:2.0:1786401047.831436:0:14241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850180608 00000100:00100000:2.0:1786401047.831503:0:14241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 5 00000100:00100000:2.0:1786401047.831515:0:14241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6fe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cedfe83e-8f3e-46c2-8429-f823952ad440+7:13717:x1873176850180608:12345-192.168.204.8@tcp:41:mount.lustre.0 00000004:00000024:2.0:1786401047.831573:0:14241:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1786401047.831689:0:14241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6fe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cedfe83e-8f3e-46c2-8429-f823952ad440+7:13717:x1873176850180608:12345-192.168.204.8@tcp:41:mount.lustre.0 Request processed in 175us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401047.831697:0:14241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 5 00000100:00100000:0.0:1786401047.831939:0:14902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 6 00000100:00100000:0.0:1786401047.831948:0:14902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6fe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cedfe83e-8f3e-46c2-8429-f823952ad440+6:0:x1873176850180480:12345-192.168.204.8@tcp:41:mount.lustre.0 00000004:00000024:0.0:1786401047.831974:0:14902:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1786401047.832007:0:14902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6fe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cedfe83e-8f3e-46c2-8429-f823952ad440+6:0:x1873176850180480:12345-192.168.204.8@tcp:41:mount.lustre.0 Request processed in 60us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401047.832013:0:14902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 6 00000100:00080000:3.0:1786401047.833587:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786401047.836388:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401047.836565:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850180736 00000100:00100000:0.0:1786401047.836579:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850180736 00000100:00100000:0.0:1786401047.836655:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 7 00000100:00100000:0.0:1786401047.836667:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+6:13717:x1873176850180736:12345-192.168.204.8@tcp:40:mount.lustre.0 00000100:00100000:0.0:1786401047.837175:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+6:13717:x1873176850180736:12345-192.168.204.8@tcp:40:mount.lustre.0 Request processed in 509us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401047.837186:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 7 00000100:00100000:1.0:1786401047.839919:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786401047.840067:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786401047.840301:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401047.840435:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850181120 00000100:00100000:0.0:1786401047.840448:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850181120 00000100:00100000:0.0:1786401047.840573:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 0 00000100:00100000:0.0:1786401047.840586:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cedfe83e-8f3e-46c2-8429-f823952ad440+6:13717:x1873176850181120:12345-192.168.204.8@tcp:33:mount.lustre.0 00000004:00080000:0.0:1786401047.841703:0:14244:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1025us 00000100:00100000:3.0:1786401047.850519:0:14878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850180864 00000100:00100000:3.0:1786401047.850541:0:14878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850180864 00000100:00100000:2.0:1786401047.850947:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850180992 00000100:00100000:2.0:1786401047.850954:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850180992 00000100:00100000:2.0:1786401047.851040:0:14880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 8 00000100:00100000:2.0:1786401047.851051:0:14880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2361:x1873176850180992:12345-192.168.204.8@tcp:8:mount.lustre.0 00010000:00080000:2.0:1786401047.851131:0:14880:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from cedfe83e-8f3e-46c2-8429-f823952ad440@192.168.204.8@tcp t0 exp 0000000000000000 cur 500 last 0 00000020:00000080:2.0:1786401047.851177:0:14880:0:(genops.c:1406:class_connect()) connect: client cedfe83e-8f3e-46c2-8429-f823952ad440, cookie 0x5ccaaf4f3cb1ec81 00002000:00100000:2.0:1786401047.851192:0:14880:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cedfe83e-8f3e-46c2-8429-f823952ad440/ffff9d6ffe128800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1786401047.851226:0:14880:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1786401047.851482:0:14880:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1786401047.851526:0:14880:0:(import.c:65:import_set_state_nolock()) ffff9d6ffe12f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786401047.851621:0:14880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+6:2361:x1873176850180992:12345-192.168.204.8@tcp:8:mount.lustre.0 Request processed in 571us (11553us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401047.851630:0:14880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 8 00000100:00100000:2.0:1786401047.852170:0:14878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 9 00000100:00100000:2.0:1786401047.852178:0:14878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6fe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2361:x1873176850180864:12345-192.168.204.8@tcp:8:mount.lustre.0 00010000:00080000:2.0:1786401047.852198:0:14878:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from cedfe83e-8f3e-46c2-8429-f823952ad440@192.168.204.8@tcp t0 exp 0000000000000000 cur 500 last 0 00000020:00000080:2.0:1786401047.852222:0:14878:0:(genops.c:1406:class_connect()) connect: client cedfe83e-8f3e-46c2-8429-f823952ad440, cookie 0x5ccaaf4f3cb1ec88 00002000:00100000:2.0:1786401047.852230:0:14878:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cedfe83e-8f3e-46c2-8429-f823952ad440/ffff9d6ffe12b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1786401047.852249:0:14878:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1786401047.852601:0:14878:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1786401047.852624:0:14878:0:(import.c:65:import_set_state_nolock()) ffff9d6ffe128000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786401047.852681:0:14878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6fe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+6:2361:x1873176850180864:12345-192.168.204.8@tcp:8:mount.lustre.0 Request processed in 502us (12776us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401047.852696:0:14878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 9 00000004:00200000:0.0:1786401047.858261:0:14244:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1786401047.858483:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cedfe83e-8f3e-46c2-8429-f823952ad440+6:13717:x1873176850181120:12345-192.168.204.8@tcp:33:mount.lustre.0 Request processed in 17891us (18173us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401047.858497:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 0 00000100:00100000:1.0:1786401048.037453:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401048.037723:0:14902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850181248 00000100:00100000:0.0:1786401048.037737:0:14902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850181248 00000100:00100000:0.0:1786401048.037820:0:14902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 8 00000100:00100000:0.0:1786401048.037834:0:14902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cedfe83e-8f3e-46c2-8429-f823952ad440+6:13763:x1873176850181248:12345-192.168.204.8@tcp:101:mkdir.0 00010000:00010000:0.0:1786401048.038355:0:14902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786401048.038396:0:14902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab000/0x5ccaaf4f3cb1ec8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bf5c expref: -99 pid: 14902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401048.038484:0:14902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1ec96 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401048.038501:0:14902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1ec96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401048.038779:0:14902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1ec96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786401048.039079:0:14902:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1786401048.039109:0:14902:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1786401048.039211:0:14902:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1ec96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401048.039252:0:14902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab000/0x5ccaaf4f3cb1ec8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bf5c expref: 8 pid: 14902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401048.039292:0:14902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1ec96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bf5c expref: 7 pid: 14902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401048.039303:0:14902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fc90cdf00) 00010000:00010000:0.0:1786401048.039307:0:14902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786401048.039310:0:14902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5aac00, rc 0) 00000100:00100000:0.0:1786401048.039733:0:14902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cedfe83e-8f3e-46c2-8429-f823952ad440+7:13763:x1873176850181248:12345-192.168.204.8@tcp:101:mkdir.0 Request processed in 1899us (2293us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401048.039743:0:14902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 8 00010000:00010000:3.0:1786401048.238392:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1786401048.403005:0:6619:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cedfe83e-8f3e-46c2-8429-f823952ad440 00000100:00100000:0.0:1786401048.815398:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873176872190208:0@lo:400:kworker.0 00000100:00100000:0.0:1786401048.815521:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401048.815606:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1786401048.815612:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:054a13af-ec40-49d6-93c2-21045d196afe:3308:1873176872189824:0@lo:400:kworker.0 00000100:00100000:0.0:1786401048.815645:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401048.815667:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873176872190336:0@lo:400:kworker.0 00000100:00100000:0.0:1786401048.815686:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401048.815728:0:14241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872190208 00000100:00100000:0.0:1786401048.815737:0:14241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872190208 00000100:00100000:0.0:1786401048.815791:0:14241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872190336 00000100:00100000:0.0:1786401048.815794:0:14241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872190336 00000100:00100000:0.0:1786401048.815827:0:14241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1786401048.815836:0:14241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fefd26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873176872190208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786401048.815900:0:14241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fefd26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873176872190208:12345-0@lo:400:kworker.0 Request processed in 65us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401048.815919:0:14241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1786401048.815940:0:14241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1786401048.815972:0:14241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fefd25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873176872190336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786401048.816015:0:14241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fefd25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873176872190336:12345-0@lo:400:kworker.0 Request processed in 69us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401048.816022:0:14241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1786401048.816051:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786401048.816121:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873176872190336:0@lo:400:kworker.0 00000100:00100000:0.0:1786401048.816134:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873176872190208:0@lo:400:kworker.0 00000100:00100000:0.0:1786401048.816169:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872190080:0@lo:400:kworker.0 00000100:00100000:0.0:1786401048.816211:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401048.816230:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1786401048.816235:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872189952:0@lo:400:kworker.0 00000100:00100000:0.0:1786401048.816252:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401048.816265:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fefd27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1873176872190464:0@lo:400:kworker.0 00000100:00100000:0.0:1786401048.816281:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401048.816301:0:14877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872190080 00000100:00100000:0.0:1786401048.816304:0:14877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872190080 00000100:00100000:0.0:1786401048.816331:0:14877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872189952 00000100:00100000:0.0:1786401048.816333:0:14877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872189952 00000100:00100000:0.0:1786401048.816346:0:14877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786401048.816351:0:14877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fefd27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1873176872190080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786401048.816380:0:14877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fefd27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1873176872190080:12345-0@lo:400:kworker.0 Request processed in 29us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401048.816386:0:14877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1786401048.816402:0:14877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1786401048.816407:0:14877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fefd25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872189952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786401048.816428:0:14877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fefd25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872189952:12345-0@lo:400:kworker.0 Request processed in 21us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401048.816433:0:14877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1786401048.816444:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786401048.816446:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786401048.816459:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872189952:0@lo:400:kworker.0 00000100:00100000:0.0:1786401048.816467:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872190080:0@lo:400:kworker.0 00000100:00100000:0.0:1786401048.816480:0:14241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872190464 00000100:00100000:0.0:1786401048.816482:0:14241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872190464 00000100:00100000:0.0:1786401048.816501:0:14241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1786401048.816506:0:14241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fefd25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1873176872190464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786401048.816529:0:14241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fefd25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1873176872190464:12345-0@lo:400:kworker.0 Request processed in 24us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401048.816534:0:14241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1786401048.816545:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786401048.816557:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fefd27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1873176872190464:0@lo:400:kworker.0 00000100:00100000:0.0:1786401048.816584:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872189824 00000100:00100000:0.0:1786401048.816587:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872189824 00000100:00100000:0.0:1786401048.816609:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1786401048.816614:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9784450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+19:3308:x1873176872189824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786401048.816645:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9784450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+19:3308:x1873176872189824:12345-0@lo:400:kworker.0 Request processed in 31us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401048.816651:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1786401048.816692:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:054a13af-ec40-49d6-93c2-21045d196afe:3308:1873176872189824:0@lo:400:kworker.0 00000100:00100000:2.0:1786401048.819403:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786401048.819435:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd891180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872190592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1786401048.820832:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401048.821327:0:14881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872190592 00000100:00100000:0.0:1786401048.821339:0:14881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872190592 00000100:00100000:0.0:1786401048.821416:0:14881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1786401048.821430:0:14881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1873176872190592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786401048.821661:0:14881:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786401048.822718:0:14881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1873176872190592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1286us (1886us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401048.822730:0:14881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1786401048.824854:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd891180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872190592:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1786401048.887935:0:7501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1786401048.887981:0:7501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cedfe83e-8f3e-46c2-8429-f823952ad440 00010000:00010000:2.0:1786401049.262357:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786401049.326731:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786401049.326928:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872190720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1786401049.327280:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786401049.327789:0:14882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872190720 00000100:00100000:3.0:1786401049.327881:0:14882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872190720 00000100:00100000:3.0:1786401049.329560:0:14882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1786401049.329590:0:14882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872190720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1786401049.329629:0:14882:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786401049.329736:0:14882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872190720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 160us (2456us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401049.329745:0:14882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1786401049.329957:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872190720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786401050.103205:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401050.104170:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850181376 00000100:00100000:0.0:1786401050.104189:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850181376 00000100:00080000:2.0:1786401050.104381:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786401050.104398:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 9 00000100:00100000:0.0:1786401050.104410:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd892300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+7:13815:x1873176850181376:12345-192.168.204.8@tcp:41:lfs.0 00000004:00000024:0.0:1786401050.104457:0:14243:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1786401050.104564:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd892300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+7:13815:x1873176850181376:12345-192.168.204.8@tcp:41:lfs.0 Request processed in 157us (1375us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401050.104573:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 9 00000100:00100000:1.0:1786401050.110891:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401050.113005:0:14881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850181504 00000100:00100000:0.0:1786401050.113022:0:14881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850181504 00000100:00100000:0.0:1786401050.113131:0:14881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 6 00000100:00100000:0.0:1786401050.113143:0:14881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cedfe83e-8f3e-46c2-8429-f823952ad440+5:13815:x1873176850181504:12345-192.168.204.8@tcp:13:lfs.0 00002000:00000024:0.0:1786401050.113181:0:14881:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786401050.113280:0:14881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cedfe83e-8f3e-46c2-8429-f823952ad440+5:13815:x1873176850181504:12345-192.168.204.8@tcp:13:lfs.0 Request processed in 139us (2401us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401050.113288:0:14881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 6 00000100:00080000:2.0:1786401050.114447:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786401050.116626:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401050.116759:0:14882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850181632 00000100:00100000:3.0:1786401050.116777:0:14882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850181632 00000100:00100000:3.0:1786401050.116956:0:14882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 7 00000100:00100000:3.0:1786401050.116970:0:14882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cedfe83e-8f3e-46c2-8429-f823952ad440+5:13815:x1873176850181632:12345-192.168.204.8@tcp:13:lfs.0 00002000:00000024:3.0:1786401050.117027:0:14882:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786401050.117212:0:14882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cedfe83e-8f3e-46c2-8429-f823952ad440+5:13815:x1873176850181632:12345-192.168.204.8@tcp:13:lfs.0 Request processed in 244us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401050.117221:0:14882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 7 00000100:00080000:2.0:1786401050.117883:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1786401050.286610:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786401050.425729:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786401050.426276:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850181760 00000100:00100000:2.0:1786401050.426288:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850181760 00000100:00100000:3.0:1786401050.427165:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 90 00000100:00100000:3.0:1786401050.427181:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9787c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a470e8d0-b507-45e2-885f-f3cf1de83cf7+10:13848:x1873176850181760:12345-192.168.204.8@tcp:101:mount.lustre.0 00010000:00010000:3.0:1786401050.427200:0:14235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786401050.427223:0:14235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fca091200/0x5ccaaf4f3cb1ec9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bf63 expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401050.427256:0:14235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fca091200/0x5ccaaf4f3cb1ec9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bf63 expref: 11 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401050.427269:0:14235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fca091200/0x5ccaaf4f3cb1ec9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bf63 expref: 11 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401050.427279:0:14235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca091200, rc 0) 00000100:00100000:3.0:1786401050.427351:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9787c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a470e8d0-b507-45e2-885f-f3cf1de83cf7+11:13848:x1873176850181760:12345-192.168.204.8@tcp:101:mount.lustre.0 Request processed in 174us (1632us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401050.427358:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 90 00000100:00100000:1.0:1786401050.434745:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401050.435012:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850181888 00000100:00100000:3.0:1786401050.435023:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850181888 00000100:00100000:3.0:1786401050.435820:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 91 00000100:00100000:3.0:1786401050.435834:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9787850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a470e8d0-b507-45e2-885f-f3cf1de83cf7+11:13848:x1873176850181888:12345-192.168.204.8@tcp:501:mount.lustre.0 00000100:00100000:3.0:1786401050.436361:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9787850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a470e8d0-b507-45e2-885f-f3cf1de83cf7+11:13848:x1873176850181888:12345-192.168.204.8@tcp:501:mount.lustre.0 Request processed in 528us (1622us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401050.436371:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 91 00000100:00100000:1.0:1786401050.441866:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401050.442978:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850182016 00000100:00100000:3.0:1786401050.443005:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850182016 00000100:00100000:3.0:1786401050.443077:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 92 00000100:00100000:3.0:1786401050.443115:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9786850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a470e8d0-b507-45e2-885f-f3cf1de83cf7+11:13848:x1873176850182016:12345-192.168.204.8@tcp:503:mount.lustre.0 00000100:00100000:3.0:1786401050.444230:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9786850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a470e8d0-b507-45e2-885f-f3cf1de83cf7+11:13848:x1873176850182016:12345-192.168.204.8@tcp:503:mount.lustre.0 Request processed in 1137us (2369us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401050.444242:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 92 00000100:00100000:1.0:1786401050.455037:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401050.458457:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850182144 00000100:00100000:3.0:1786401050.458476:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850182144 00000100:00100000:3.0:1786401050.458579:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 93 00000100:00100000:3.0:1786401050.458590:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9784c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a470e8d0-b507-45e2-885f-f3cf1de83cf7+11:13854:x1873176850182144:12345-192.168.204.8@tcp:502:llog_process_th.0 00000100:00100000:3.0:1786401050.458928:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9784c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a470e8d0-b507-45e2-885f-f3cf1de83cf7+11:13854:x1873176850182144:12345-192.168.204.8@tcp:502:llog_process_th.0 Request processed in 339us (3903us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401050.458936:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 93 00000100:00100000:1.0:1786401050.483023:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401050.484702:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850182272 00000100:00100000:3.0:1786401050.484718:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850182272 00000100:00100000:3.0:1786401050.484860:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 94 00000100:00100000:3.0:1786401050.484872:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9787450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a470e8d0-b507-45e2-885f-f3cf1de83cf7+11:13854:x1873176850182272:12345-192.168.204.8@tcp:502:llog_process_th.0 00000100:00100000:3.0:1786401050.485197:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9787450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a470e8d0-b507-45e2-885f-f3cf1de83cf7+11:13854:x1873176850182272:12345-192.168.204.8@tcp:502:llog_process_th.0 Request processed in 327us (2183us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401050.485207:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 94 00000100:00100000:1.0:1786401050.493872:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401050.495054:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850182400 00000100:00100000:0.0:1786401050.495065:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850182400 00000100:00100000:0.0:1786401050.495143:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 95 00000100:00100000:0.0:1786401050.495154:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9786c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a470e8d0-b507-45e2-885f-f3cf1de83cf7+11:13848:x1873176850182400:12345-192.168.204.8@tcp:101:mount.lustre.0 00010000:00010000:0.0:1786401050.495275:0:14233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786401050.495297:0:14233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ffd5ab000/0x5ccaaf4f3cb1eca4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bf8d expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401050.495326:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ffd5ab000/0x5ccaaf4f3cb1eca4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bf8d expref: 12 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401050.495417:0:14233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ffd5ab000/0x5ccaaf4f3cb1eca4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bf8d expref: 12 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401050.495429:0:14233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5ab000, rc 0) 00000100:00100000:0.0:1786401050.495832:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9786c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a470e8d0-b507-45e2-885f-f3cf1de83cf7+12:13848:x1873176850182400:12345-192.168.204.8@tcp:101:mount.lustre.0 Request processed in 674us (1964us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401050.495844:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 95 00000100:00100000:1.0:1786401050.502993:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401050.504055:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850182528 00000100:00100000:0.0:1786401050.504067:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850182528 00000100:00100000:0.0:1786401050.504261:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 96 00000100:00100000:0.0:1786401050.504273:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc9785050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a470e8d0-b507-45e2-885f-f3cf1de83cf7+12:13848:x1873176850182528:12345-192.168.204.8@tcp:256:mount.lustre.0 20000000:01000000:0.0:1786401050.504300:0:14235:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1786401050.504324:0:14235:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1786401050.504328:0:14235:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1786401050.504331:0:14235:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1786401050.504334:0:14235:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1786401050.507473:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc9785050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a470e8d0-b507-45e2-885f-f3cf1de83cf7+12:13848:x1873176850182528:12345-192.168.204.8@tcp:256:mount.lustre.0 Request processed in 3190us (4477us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401050.507488:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 96 00000100:00100000:1.0:1786401050.514332:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401050.514780:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850182656 00000100:00100000:0.0:1786401050.514791:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850182656 00000100:00100000:0.0:1786401050.514853:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 97 00000100:00100000:0.0:1786401050.514864:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a470e8d0-b507-45e2-885f-f3cf1de83cf7+12:13848:x1873176850182656:12345-192.168.204.8@tcp:101:mount.lustre.0 00010000:00010000:0.0:1786401050.514883:0:14233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786401050.514904:0:14233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1ecab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bf94 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401050.515572:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1ecab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bf94 expref: 13 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401050.515585:0:14233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1ecab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bf94 expref: 13 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401050.515596:0:14233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5aa600, rc 0) 00000100:00100000:0.0:1786401050.515829:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a470e8d0-b507-45e2-885f-f3cf1de83cf7+13:13848:x1873176850182656:12345-192.168.204.8@tcp:101:mount.lustre.0 Request processed in 965us (1508us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401050.515837:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 97 00000100:00100000:1.0:1786401050.521195:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401050.521476:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850182784 00000100:00100000:0.0:1786401050.521488:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850182784 00000100:00100000:0.0:1786401050.521929:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 98 00000100:00100000:0.0:1786401050.521940:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a470e8d0-b507-45e2-885f-f3cf1de83cf7+13:13848:x1873176850182784:12345-192.168.204.8@tcp:501:mount.lustre.0 00000100:00100000:0.0:1786401050.523762:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a470e8d0-b507-45e2-885f-f3cf1de83cf7+13:13848:x1873176850182784:12345-192.168.204.8@tcp:501:mount.lustre.0 Request processed in 1816us (2568us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401050.523776:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 98 00000100:00100000:1.0:1786401050.528398:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401050.528500:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850182912 00000100:00100000:0.0:1786401050.528511:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850182912 00000100:00100000:0.0:1786401050.528879:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 99 00000100:00100000:0.0:1786401050.528904:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a470e8d0-b507-45e2-885f-f3cf1de83cf7+13:13848:x1873176850182912:12345-192.168.204.8@tcp:503:mount.lustre.0 00000100:00100000:0.0:1786401050.529833:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a470e8d0-b507-45e2-885f-f3cf1de83cf7+13:13848:x1873176850182912:12345-192.168.204.8@tcp:503:mount.lustre.0 Request processed in 267us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401050.529846:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 99 00000100:00100000:1.0:1786401050.536061:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401050.536455:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850183040 00000100:00100000:0.0:1786401050.536468:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850183040 00000100:00100000:0.0:1786401050.536524:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 100 00000100:00100000:0.0:1786401050.536545:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a470e8d0-b507-45e2-885f-f3cf1de83cf7+13:13859:x1873176850183040:12345-192.168.204.8@tcp:502:llog_process_th.0 00000100:00100000:0.0:1786401050.536978:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a470e8d0-b507-45e2-885f-f3cf1de83cf7+13:13859:x1873176850183040:12345-192.168.204.8@tcp:502:llog_process_th.0 Request processed in 443us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401050.536987:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 100 00000100:00100000:1.0:1786401050.542423:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401050.542776:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850183168 00000100:00100000:0.0:1786401050.542787:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850183168 00000100:00100000:0.0:1786401050.542856:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 101 00000100:00100000:0.0:1786401050.542867:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a470e8d0-b507-45e2-885f-f3cf1de83cf7+13:13859:x1873176850183168:12345-192.168.204.8@tcp:502:llog_process_th.0 00000100:00100000:0.0:1786401050.544713:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a470e8d0-b507-45e2-885f-f3cf1de83cf7+13:13859:x1873176850183168:12345-192.168.204.8@tcp:502:llog_process_th.0 Request processed in 1832us (2285us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401050.544726:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 101 00000100:00100000:1.0:1786401050.559979:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401050.560214:0:14241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850183296 00000100:00100000:0.0:1786401050.560225:0:14241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850183296 00000100:00100000:0.0:1786401050.560278:0:14241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 10 00000100:00100000:0.0:1786401050.560287:0:14241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2361:x1873176850183296:12345-192.168.204.8@tcp:38:mount.lustre.0 00010000:00080000:0.0:1786401050.560320:0:14241:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 9366b5e6-e19b-4a08-b543-2a32b0307b57@192.168.204.8@tcp t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:0.0:1786401050.560636:0:14241:0:(genops.c:1406:class_connect()) connect: client 9366b5e6-e19b-4a08-b543-2a32b0307b57, cookie 0x5ccaaf4f3cb1ecb2 00000004:00100000:0.0:1786401050.560670:0:14241:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1786401050.560996:0:14241:0:(import.c:65:import_set_state_nolock()) ffff9d6fc4812800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1786401050.561499:0:14241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9366b5e6-e19b-4a08-b543-2a32b0307b57+6:2361:x1873176850183296:12345-192.168.204.8@tcp:38:mount.lustre.0 Request processed in 1209us (1527us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401050.561508:0:14241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 10 00000100:00100000:1.0:1786401050.568932:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786401050.569053:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401050.569216:0:14902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850183424 00000100:00100000:0.0:1786401050.569232:0:14902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850183424 00000100:00100000:2.0:1786401050.569243:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850183552 00000100:00100000:2.0:1786401050.569261:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850183552 00000100:00080000:3.0:1786401050.569594:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786401050.569687:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 11 00000100:00100000:2.0:1786401050.569703:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9366b5e6-e19b-4a08-b543-2a32b0307b57+7:13848:x1873176850183552:12345-192.168.204.8@tcp:41:mount.lustre.0 00000004:00000024:2.0:1786401050.569739:0:14243:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1786401050.569879:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9366b5e6-e19b-4a08-b543-2a32b0307b57+7:13848:x1873176850183552:12345-192.168.204.8@tcp:41:mount.lustre.0 Request processed in 180us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401050.569886:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 11 00000100:00100000:0.0:1786401050.569946:0:14902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 12 00000100:00100000:0.0:1786401050.569962:0:14902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9366b5e6-e19b-4a08-b543-2a32b0307b57+6:0:x1873176850183424:12345-192.168.204.8@tcp:41:mount.lustre.0 00000004:00000024:0.0:1786401050.569993:0:14902:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1786401050.570046:0:14902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9366b5e6-e19b-4a08-b543-2a32b0307b57+6:0:x1873176850183424:12345-192.168.204.8@tcp:41:mount.lustre.0 Request processed in 90us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401050.570054:0:14902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 12 00000100:00100000:1.0:1786401050.574278:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786401050.574389:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850183680 00000100:00100000:2.0:1786401050.574400:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850183680 00000100:00100000:2.0:1786401050.574667:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 13 00000100:00100000:2.0:1786401050.574678:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9366b5e6-e19b-4a08-b543-2a32b0307b57+6:13848:x1873176850183680:12345-192.168.204.8@tcp:40:mount.lustre.0 00000100:00100000:2.0:1786401050.574855:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9366b5e6-e19b-4a08-b543-2a32b0307b57+6:13848:x1873176850183680:12345-192.168.204.8@tcp:40:mount.lustre.0 Request processed in 178us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401050.574863:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 13 00000100:00100000:2.0:1786401050.579480:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786401050.579531:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786401050.581822:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786401050.582079:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850184064 00000100:00100000:1.0:1786401050.582108:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850184064 00000100:00100000:1.0:1786401050.582159:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1 00000100:00100000:1.0:1786401050.582168:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9366b5e6-e19b-4a08-b543-2a32b0307b57+6:13848:x1873176850184064:12345-192.168.204.8@tcp:33:mount.lustre.0 00000004:00200000:1.0:1786401050.582407:0:14245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1786401050.582677:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9366b5e6-e19b-4a08-b543-2a32b0307b57+6:13848:x1873176850184064:12345-192.168.204.8@tcp:33:mount.lustre.0 Request processed in 508us (3207us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401050.582685:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1 00000100:00100000:3.0:1786401050.583877:0:14878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850183808 00000100:00100000:3.0:1786401050.583888:0:14878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850183808 00000100:00100000:3.0:1786401050.584012:0:14878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850183936 00000100:00100000:3.0:1786401050.584016:0:14878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850183936 00000100:00100000:3.0:1786401050.584031:0:14878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 10 00000100:00100000:3.0:1786401050.584038:0:14878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2361:x1873176850183808:12345-192.168.204.8@tcp:8:mount.lustre.0 00010000:00080000:3.0:1786401050.584082:0:14878:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 9366b5e6-e19b-4a08-b543-2a32b0307b57@192.168.204.8@tcp t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:3.0:1786401050.584134:0:14878:0:(genops.c:1406:class_connect()) connect: client 9366b5e6-e19b-4a08-b543-2a32b0307b57, cookie 0x5ccaaf4f3cb1ecb9 00002000:00100000:3.0:1786401050.584146:0:14878:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9366b5e6-e19b-4a08-b543-2a32b0307b57/ffff9d6fc49f0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1786401050.584159:0:14878:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1786401050.584783:0:14878:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1786401050.586860:0:14878:0:(import.c:65:import_set_state_nolock()) ffff9d6fc3074000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786401050.587067:0:14878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9366b5e6-e19b-4a08-b543-2a32b0307b57+6:2361:x1873176850183808:12345-192.168.204.8@tcp:8:mount.lustre.0 Request processed in 3022us (7529us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401050.587079:0:14878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 10 00000100:00100000:2.0:1786401050.587142:0:14878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 11 00000100:00100000:2.0:1786401050.587148:0:14878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2361:x1873176850183936:12345-192.168.204.8@tcp:8:mount.lustre.0 00010000:00080000:2.0:1786401050.587184:0:14878:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 9366b5e6-e19b-4a08-b543-2a32b0307b57@192.168.204.8@tcp t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:2.0:1786401050.587211:0:14878:0:(genops.c:1406:class_connect()) connect: client 9366b5e6-e19b-4a08-b543-2a32b0307b57, cookie 0x5ccaaf4f3cb1ecc0 00002000:00100000:2.0:1786401050.587222:0:14878:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9366b5e6-e19b-4a08-b543-2a32b0307b57/ffff9d6ffe12c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1786401050.587231:0:14878:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1786401050.587462:0:14878:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1786401050.587483:0:14878:0:(import.c:65:import_set_state_nolock()) ffff9d6ffe12e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1786401050.587508:0:14878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9366b5e6-e19b-4a08-b543-2a32b0307b57+6:2361:x1873176850183936:12345-192.168.204.8@tcp:8:mount.lustre.0 Request processed in 359us (5692us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401050.587515:0:14878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 11 00000100:00100000:3.0:1786401050.771676:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401050.772174:0:14902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850184192 00000100:00100000:0.0:1786401050.772185:0:14902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850184192 00000100:00100000:0.0:1786401050.772253:0:14902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14 00000100:00100000:0.0:1786401050.772264:0:14902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9366b5e6-e19b-4a08-b543-2a32b0307b57+6:13880:x1873176850184192:12345-192.168.204.8@tcp:101:mkdir.0 00010000:00010000:0.0:1786401050.772286:0:14902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786401050.773474:0:14902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1ecc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bfbe expref: -99 pid: 14902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401050.773556:0:14902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5abe00/0x5ccaaf4f3cb1ecce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401050.773569:0:14902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5abe00/0x5ccaaf4f3cb1ecce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401050.773582:0:14902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5abe00/0x5ccaaf4f3cb1ecce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786401050.773793:0:14902:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1786401050.773798:0:14902:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1786401050.773875:0:14902:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5abe00/0x5ccaaf4f3cb1ecce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401050.773918:0:14902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1ecc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bfbe expref: 8 pid: 14902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401050.773939:0:14902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5abe00/0x5ccaaf4f3cb1ecce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bfbe expref: 7 pid: 14902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401050.773947:0:14902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fc90cdf00) 00010000:00010000:0.0:1786401050.773950:0:14902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786401050.773953:0:14902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5abe00, rc 0) 00000100:00100000:0.0:1786401050.774025:0:14902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9366b5e6-e19b-4a08-b543-2a32b0307b57+7:13880:x1873176850184192:12345-192.168.204.8@tcp:101:mkdir.0 Request processed in 1762us (2359us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401050.774033:0:14902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14 00000040:00080000:0.0:1786401050.863201:0:14275:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1786401051.310498:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786401052.337908:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1786401052.946888:0:5810:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9366b5e6-e19b-4a08-b543-2a32b0307b57 00000001:00100000:3.0:1786401052.946922:0:5810:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cedfe83e-8f3e-46c2-8429-f823952ad440 00010000:00010000:2.0:1786401053.358537:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1786401053.508335:0:6619:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9366b5e6-e19b-4a08-b543-2a32b0307b57 00000100:00100000:2.0:1786401053.936113:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872190976:0@lo:400:kworker.0 00000100:00100000:2.0:1786401053.936177:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786401053.936219:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873176872191488:0@lo:400:kworker.0 00000100:00100000:2.0:1786401053.936242:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786401053.936261:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786401053.936266:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872191104:0@lo:400:kworker.0 00000100:00100000:2.0:1786401053.936281:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786401053.936308:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872190976 00000100:00100000:2.0:1786401053.936315:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872190976 00000100:00100000:2.0:1786401053.936370:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872191104 00000100:00100000:2.0:1786401053.936372:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872191104 00000100:00100000:2.0:1786401053.936387:0:14880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1786401053.936395:0:14880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872190976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786401053.936609:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:054a13af-ec40-49d6-93c2-21045d196afe:3309:1873176872190848:0@lo:400:kworker.0 00000100:00100000:1.0:1786401053.936643:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401053.936667:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873176872191360:0@lo:400:kworker.0 00000100:00100000:1.0:1786401053.936687:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401053.936705:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1786401053.936717:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873176872191232:0@lo:400:kworker.0 00000100:00100000:1.0:1786401053.936737:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786401053.937564:0:14880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872190976:12345-0@lo:400:kworker.0 Request processed in 1166us (1383us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401053.937574:0:14880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1786401053.937599:0:14880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1786401053.937608:0:14880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872191104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786401053.937644:0:14880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872191104:12345-0@lo:400:kworker.0 Request processed in 39us (1361us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401053.937650:0:14880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1786401053.937668:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1786401053.937673:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1786401053.937860:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872191488 00000100:00100000:1.0:1786401053.937866:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872191488 00000100:00100000:1.0:1786401053.937899:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872191360 00000100:00100000:1.0:1786401053.937901:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872191360 00000100:00100000:1.0:1786401053.937912:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872191232 00000100:00100000:1.0:1786401053.937915:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872191232 00000100:00100000:1.0:1786401053.937927:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1786401053.937933:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873176872191488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786401053.937964:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1873176872191488:12345-0@lo:400:kworker.0 Request processed in 31us (1720us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401053.937970:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1786401053.937981:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1786401053.937987:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873176872191360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786401053.938019:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873176872191360:12345-0@lo:400:kworker.0 Request processed in 31us (1330us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401053.938024:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1786401053.938151:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872191616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786401053.938186:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401053.938222:0:14902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1786401053.938229:0:14902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873176872191232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786401053.938260:0:14902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1873176872191232:12345-0@lo:400:kworker.0 Request processed in 31us (1521us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401053.938265:0:14902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1786401053.938294:0:14881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872191616 00000100:00100000:0.0:1786401053.938297:0:14881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872191616 00000100:00100000:0.0:1786401053.938323:0:14881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1786401053.938330:0:14881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fefd27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872191616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1786401053.938357:0:14881:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786401053.938391:0:14881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fefd27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872191616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401053.938397:0:14881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1786401053.938531:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786401053.938601:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872190848 00000100:00100000:1.0:1786401053.938605:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872190848 00000100:00100000:1.0:1786401053.938629:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1786401053.938635:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+19:3309:x1873176872190848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1786401053.938667:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+19:3309:x1873176872190848:12345-0@lo:400:kworker.0 Request processed in 32us (2023us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401053.938672:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1786401053.938736:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1873176872191232:0@lo:400:kworker.0 00000100:00100000:1.0:1786401053.938747:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:054a13af-ec40-49d6-93c2-21045d196afe:3309:1873176872190848:0@lo:400:kworker.0 00000100:00100000:1.0:1786401053.939129:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873176872191360:0@lo:400:kworker.0 00000100:00100000:1.0:1786401053.939161:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1786401053.939170:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872191104:0@lo:400:kworker.0 00000100:00100000:1.0:1786401053.939180:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872190976:0@lo:400:kworker.0 00000100:00100000:1.0:1786401053.939190:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1873176872191488:0@lo:400:kworker.0 00000100:00100000:0.0:1786401053.940733:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872191616:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1786401054.018741:0:7501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9366b5e6-e19b-4a08-b543-2a32b0307b57 00000001:02000400:3.0:1786401054.039673:0:16106:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1786401054.382284:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786401054.448451:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872191744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1786401054.448775:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786401054.449053:0:14881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872191744 00000100:00100000:2.0:1786401054.449062:0:14881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872191744 00000100:00100000:2.0:1786401054.449144:0:14881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1786401054.449153:0:14881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fefd24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872191744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1786401054.449192:0:14881:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1786401054.449246:0:14881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fefd24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872191744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401054.449253:0:14881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1786401054.449815:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872191744:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1786401055.406850:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786401055.796050:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401055.796310:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850184320 00000100:00100000:0.0:1786401055.796324:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850184320 00000100:00100000:0.0:1786401055.796392:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 103 00000100:00100000:0.0:1786401055.796405:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a470e8d0-b507-45e2-885f-f3cf1de83cf7+13:2362:x1873176850184320:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:1.0:1786401055.796438:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786401055.796467:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786401055.796487:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401055.796503:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a470e8d0-b507-45e2-885f-f3cf1de83cf7+13:2362:x1873176850184320:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 102us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401055.796607:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 103 00000100:00100000:0.0:1786401055.796655:0:14902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850184832 00000100:00100000:0.0:1786401055.796660:0:14902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850184832 00000100:00100000:0.0:1786401055.797328:0:14902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 19 00000100:00100000:0.0:1786401055.797343:0:14902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9366b5e6-e19b-4a08-b543-2a32b0307b57+6:2362:x1873176850184832:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:2.0:1786401055.797344:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850184576 00000100:00100000:2.0:1786401055.797350:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850184576 00000100:00100000:2.0:1786401055.797384:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850185088 00000100:00100000:2.0:1786401055.797388:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850185088 00000100:00100000:0.0:1786401055.797404:0:14902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9366b5e6-e19b-4a08-b543-2a32b0307b57+6:2362:x1873176850184832:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 67us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401055.797411:0:14902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 19 00000100:00100000:2.0:1786401055.797429:0:14880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 6 00000100:00100000:2.0:1786401055.797436:0:14880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+5:2362:x1873176850184576:12345-192.168.204.8@tcp:400:kworker.0 00000100:00080000:0.0:1786401055.797442:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786401055.797454:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786401055.797457:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786401055.797464:0:14880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+5:2362:x1873176850184576:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 30us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401055.797471:0:14880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 6 00000100:00100000:2.0:1786401055.797484:0:14880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 7 00000100:00100000:2.0:1786401055.797490:0:14880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9366b5e6-e19b-4a08-b543-2a32b0307b57+5:2362:x1873176850185088:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:2.0:1786401055.797510:0:14880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9366b5e6-e19b-4a08-b543-2a32b0307b57+5:2362:x1873176850185088:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 21us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401055.797516:0:14880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 7 00000100:00100000:0.0:1786401055.800366:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401055.800402:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401055.800438:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401055.800476:0:14877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850184704 00000100:00100000:0.0:1786401055.800488:0:14877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850184704 00000100:00100000:0.0:1786401055.800554:0:14877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850184960 00000100:00100000:0.0:1786401055.800558:0:14877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850184960 00000100:00100000:0.0:1786401055.800579:0:14877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 8 00000100:00100000:0.0:1786401055.800590:0:14877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fefd27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cedfe83e-8f3e-46c2-8429-f823952ad440+5:2362:x1873176850184704:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786401055.800678:0:14877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fefd27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cedfe83e-8f3e-46c2-8429-f823952ad440+5:2362:x1873176850184704:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 89us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401055.800686:0:14877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 8 00000100:00100000:0.0:1786401055.800707:0:14877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 9 00000100:00100000:0.0:1786401055.800713:0:14877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fefd24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9366b5e6-e19b-4a08-b543-2a32b0307b57+5:2362:x1873176850184960:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786401055.800740:0:14877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fefd24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9366b5e6-e19b-4a08-b543-2a32b0307b57+5:2362:x1873176850184960:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 27us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401055.800746:0:14877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 9 00000100:00080000:0.0:1786401055.800763:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1786401055.800767:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786401055.801791:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850184448 00000100:00100000:1.0:1786401055.801802:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850184448 00000100:00080000:0.0:1786401055.801960:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1786401055.802340:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 20 00000100:00100000:1.0:1786401055.802351:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fefd25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+6:2362:x1873176850184448:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:1.0:1786401055.802430:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fefd25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+6:2362:x1873176850184448:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 81us (2079us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401055.802438:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 20 00010000:00010000:2.0:1786401056.431687:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786401057.457570:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1786401058.221299:0:16255:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffd39955ac0 00000020:00000080:0.0:1786401058.221323:0:16255:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:0.0:1786401058.221329:0:16255:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:0.0:1786401058.221337:0:16255:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd39957d50 20000000:00000080:0.0:1786401058.221345:0:16255:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d6fc5ed1000 uarg=0000000000000000 20000000:01000000:0.0:1786401058.221401:0:16255:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1786401058.221409:0:16255:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1786401058.221422:0:16255:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1786401058.222560:0:16256:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1786401058.222751:0:16255:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1786401058.230939:0:16255:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1786401058.231303:0:16255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d6fc138e200/0x5ccaaf4f3cb1ecd5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401058.231330:0:16255:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e9cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1e9c5 expref: 18 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401058.231338:0:16255:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1ea19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1ea12 expref: 18 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401058.231363:0:16255:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fca090800/0x5ccaaf4f3cb1eb54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1eb4d expref: 18 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401058.231374:0:16255:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fca090e00/0x5ccaaf4f3cb1ec73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bf32 expref: 12 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401058.231382:0:16255:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1ecab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bf94 expref: 12 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401058.231390:0:16255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d6fc138e200/0x5ccaaf4f3cb1ecd5 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401058.231448:0:16255:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1ecab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bf94 expref: 12 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401058.231468:0:16255:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1ecab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bf94 expref: 12 pid: 14233 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786401058.231500:0:16255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6ee0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16255:1873176872191872:192.168.204.8@tcp:104: 00010000:00010000:1.0:1786401058.231632:0:16255:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fca090e00/0x5ccaaf4f3cb1ec73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bf32 expref: 12 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401058.231641:0:16255:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d6fca090e00/0x5ccaaf4f3cb1ec73 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bf32 expref: 12 pid: 14235 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786401058.231650:0:16255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6ee2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16255:1873176872192000:192.168.204.8@tcp:104: 00010000:00010000:1.0:1786401058.231675:0:16255:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fca090800/0x5ccaaf4f3cb1eb54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5ccaaf4f3cb1eb4d expref: 18 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401058.231695:0:16255:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d6fca090800/0x5ccaaf4f3cb1eb54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1eb4d expref: 18 pid: 14235 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786401058.231705:0:16255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff6ee2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16255:1873176872192128:0@lo:104: 00000100:00100000:1.0:1786401058.231750:0:16255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786401058.231809:0:16255:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1ea19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5ccaaf4f3cb1ea12 expref: 18 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401058.231818:0:16255:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1ea19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1ea12 expref: 18 pid: 14233 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786401058.231826:0:16255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde20a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16255:1873176872192256:0@lo:104: 00000100:00100000:1.0:1786401058.231846:0:16255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1786401058.231865:0:16255:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e9cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5ccaaf4f3cb1e9c5 expref: 18 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401058.231873:0:16255:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e9cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1e9c5 expref: 18 pid: 14233 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786401058.231881:0:16255:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde23100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16255:1873176872192384:0@lo:104: 00000100:00100000:1.0:1786401058.231901:0:16255:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401058.231910:0:16255:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc34ea240 going to sleep for 11 seconds 00000100:00100000:2.0:1786401058.232688:0:14225:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1786401058.232713:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872192128 00000100:00100000:2.0:1786401058.232721:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872192128 00000100:00100000:2.0:1786401058.232786:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872192256 00000100:00100000:2.0:1786401058.232790:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872192256 00000100:00100000:2.0:1786401058.232802:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872192384 00000100:00100000:2.0:1786401058.232804:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872192384 00000100:00100000:2.0:1786401058.232819:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1786401058.232829:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:054a13af-ec40-49d6-93c2-21045d196afe+5:16255:x1873176872192128:12345-0@lo:104: 00010000:00010000:2.0:1786401058.232847:0:14225:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.108@tcp lock: ffff9d6fca091800/0x5ccaaf4f3cb1eb4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1eb54 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401058.232924:0:14225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1786401058.232930:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:054a13af-ec40-49d6-93c2-21045d196afe+5:16255:x1873176872192128:12345-0@lo:104: Request processed in 103us (1180us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401058.232953:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1786401058.233412:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1786401058.233420:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:054a13af-ec40-49d6-93c2-21045d196afe+4:16255:x1873176872192256:12345-0@lo:104: 00010000:00010000:2.0:1786401058.233431:0:14225:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.108@tcp lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1ea12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1ea19 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401058.233476:0:14225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1786401058.233481:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:054a13af-ec40-49d6-93c2-21045d196afe+4:16255:x1873176872192256:12345-0@lo:104: Request processed in 63us (1635us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401058.233487:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1786401058.233497:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1786401058.233503:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff696e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:054a13af-ec40-49d6-93c2-21045d196afe+3:16255:x1873176872192384:12345-0@lo:104: 00010000:00010000:2.0:1786401058.233510:0:14225:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.108@tcp lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e9c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1e9cc expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401058.233537:0:14225:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1786401058.233541:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff696e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:054a13af-ec40-49d6-93c2-21045d196afe+3:16255:x1873176872192384:12345-0@lo:104: Request processed in 39us (1639us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401058.233547:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1786401058.233588:0:14230:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1786401058.233594:0:14230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fca091800/0x5ccaaf4f3cb1eb4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1eb54 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401058.233603:0:14230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca091800 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:2.0:1786401058.233608:0:14230:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fca091800/0x5ccaaf4f3cb1eb4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5ccaaf4f3cb1eb54 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401058.233632:0:14230:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fca091800/0x5ccaaf4f3cb1eb4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5ccaaf4f3cb1eb54 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1786401058.233640:0:14230:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fca091800/0x5ccaaf4f3cb1eb4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5ccaaf4f3cb1eb54 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1786401058.233647:0:14230:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1786401058.234080:0:15374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1786401058.234183:0:15374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1ea12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1ea19 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401058.234193:0:15374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138fa00 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:0.0:1786401058.234196:0:15374:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1ea12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5ccaaf4f3cb1ea19 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401058.234204:0:15374:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1ea12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5ccaaf4f3cb1ea19 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786401058.234210:0:15374:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1ea12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5ccaaf4f3cb1ea19 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786401058.234216:0:15374:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1786401058.234266:0:15374:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1ea12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1ea19 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401058.234273:0:15374:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786401058.234299:0:15374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1ea12 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1ea19 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401058.234305:0:15374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1ea12 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1ea19 expref: -99 pid: 14876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401058.234324:0:15374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786401058.234327:0:15374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e9c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5ccaaf4f3cb1e9cc expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401058.234348:0:15374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1bbe00 already unused, calling callback (ffffffffc1d6dc20) 10000000:00010000:0.0:1786401058.234351:0:15374:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e9c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5ccaaf4f3cb1e9cc expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401058.234357:0:15374:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e9c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5ccaaf4f3cb1e9cc expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1786401058.234363:0:15374:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e9c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5ccaaf4f3cb1e9cc expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786401058.234368:0:15374:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1786401058.234382:0:15374:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e9c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1e9cc expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401058.234388:0:15374:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1786401058.234404:0:15374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e9c5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1e9cc expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401058.234410:0:15374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1e9c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1e9cc expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401058.234421:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786401058.234423:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786401058.234425:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786401058.234455:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fefd24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:054a13af-ec40-49d6-93c2-21045d196afe:3309:1873176872192512:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1786401058.235017:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1786401058.235069:0:16255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6ee2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16255:1873176872192128:0@lo:104: 00000100:00100000:1.0:1786401058.235082:0:16255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde20a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16255:1873176872192256:0@lo:104: 00000100:00100000:0.0:1786401058.235335:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401058.235414:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fefd26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:054a13af-ec40-49d6-93c2-21045d196afe:3306:1873176872192640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786401058.235446:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401058.235501:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872192512 00000100:00100000:0.0:1786401058.235518:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872192512 00010000:00010000:0.0:1786401058.235555:0:14228:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1ea19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1ea12 expref: 19 pid: 14233 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786401058.235588:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872192640 00000100:00100000:0.0:1786401058.235591:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872192640 00010000:00010000:0.0:1786401058.235603:0:14228:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e9cc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1e9c5 expref: 20 pid: 14233 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786401058.235618:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1786401058.235626:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fefd25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:054a13af-ec40-49d6-93c2-21045d196afe+20:3309:x1873176872192512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786401058.235641:0:14228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786401058.235647:0:14228:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1ea19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1ea12 expref: 20 pid: 14233 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401058.235658:0:14228:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1ea19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1ea12 expref: 20 pid: 14233 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401058.235677:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1ea19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1ea12 expref: 20 pid: 14233 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401058.235696:0:14228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786401058.235732:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fefd25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:054a13af-ec40-49d6-93c2-21045d196afe+19:3309:x1873176872192512:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401058.235739:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1786401058.235755:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1786401058.235775:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fefd26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:054a13af-ec40-49d6-93c2-21045d196afe+18:3306:x1873176872192640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1786401058.235783:0:14228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786401058.235787:0:14228:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e9cc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1e9c5 expref: 18 pid: 14233 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401058.235802:0:14228:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e9cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1e9c5 expref: 18 pid: 14233 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401058.235813:0:14228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786401058.235841:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fefd26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:054a13af-ec40-49d6-93c2-21045d196afe+18:3306:x1873176872192640:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401058.235847:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1786401058.235885:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fefd26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:054a13af-ec40-49d6-93c2-21045d196afe:3306:1873176872192640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786401058.235911:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fefd24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:054a13af-ec40-49d6-93c2-21045d196afe:3309:1873176872192512:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786401058.237206:0:14230:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.108@tcp lock: ffff9d6fca091800/0x5ccaaf4f3cb1eb4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1eb54 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401058.237225:0:14230:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1786401058.237250:0:14230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff9d6fca091800/0x5ccaaf4f3cb1eb4d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1eb54 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401058.237259:0:14230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff9d6fca091800/0x5ccaaf4f3cb1eb4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5ccaaf4f3cb1eb54 expref: -99 pid: 15546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401058.237287:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401058.237289:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401058.237292:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1786401058.237638:0:16255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc138e600/0x5ccaaf4f3cb1e9cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1e9c5 expref: 17 pid: 14233 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786401058.237682:0:16255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde23100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16255:1873176872192384:0@lo:104: 00000100:00100000:0.0:1786401058.239035:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdbc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:054a13af-ec40-49d6-93c2-21045d196afe:3307:1873176872192768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1786401058.239462:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786401058.240081:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872192768 00000100:00100000:2.0:1786401058.240121:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872192768 00010000:00010000:2.0:1786401058.240169:0:14228:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fca090800/0x5ccaaf4f3cb1eb54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1eb4d expref: 17 pid: 14235 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786401058.240209:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1786401058.240220:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:054a13af-ec40-49d6-93c2-21045d196afe+17:3307:x1873176872192768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1786401058.240237:0:14228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786401058.240243:0:14228:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fca090800/0x5ccaaf4f3cb1eb54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1eb4d expref: 17 pid: 14235 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401058.240275:0:14228:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fca090800/0x5ccaaf4f3cb1eb54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1eb4d expref: 17 pid: 14235 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401058.240298:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fca090800/0x5ccaaf4f3cb1eb54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5ccaaf4f3cb1eb4d expref: 17 pid: 14235 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401058.240317:0:14228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786401058.240369:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:054a13af-ec40-49d6-93c2-21045d196afe+16:3307:x1873176872192768:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401058.240385:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1786401058.241247:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdbc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:054a13af-ec40-49d6-93c2-21045d196afe:3307:1873176872192768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1786401058.241528:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401058.241618:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850185344 00000100:00100000:1.0:1786401058.241627:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786401058.241654:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850185216 00000100:00100000:1.0:1786401058.241659:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850185216 00010000:00010000:1.0:1786401058.241693:0:14228:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1ecab lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bf94 expref: 13 pid: 14233 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786401058.241718:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 7 00000100:00100000:1.0:1786401058.241728:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a470e8d0-b507-45e2-885f-f3cf1de83cf7+13:2364:x1873176850185216:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786401058.241742:0:14228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786401058.241747:0:14228:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1ecab lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bf94 expref: 13 pid: 14233 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401058.241782:0:14228:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1ecab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bf94 expref: 13 pid: 14233 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401058.241806:0:14228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786401058.241946:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a470e8d0-b507-45e2-885f-f3cf1de83cf7+13:2364:x1873176850185216:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 218us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401058.241954:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 7 00000100:00100000:0.0:1786401058.242391:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850185344 00010000:00010000:3.0:1786401058.242413:0:16255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1ecab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bf94 expref: 13 pid: 14233 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401058.242414:0:14226:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fca090e00/0x5ccaaf4f3cb1ec73 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bf32 expref: 13 pid: 14235 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786401058.242429:0:16255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6ee0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16255:1873176872191872:192.168.204.8@tcp:104: 00000100:00100000:3.0:1786401058.242443:0:16255:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff6ee2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16255:1873176872192000:192.168.204.8@tcp:104: 00000100:00100000:0.0:1786401058.242449:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 8 00000100:00100000:0.0:1786401058.242456:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a470e8d0-b507-45e2-885f-f3cf1de83cf7+12:2364:x1873176850185344:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786401058.242465:0:14226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786401058.242470:0:14226:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fca090e00/0x5ccaaf4f3cb1ec73 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bf32 expref: 12 pid: 14235 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401058.242479:0:16255:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d6fc138e200/0x5ccaaf4f3cb1ecd5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401058.242899:0:14226:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fca090e00/0x5ccaaf4f3cb1ec73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bf32 expref: 12 pid: 14235 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401058.243008:0:14226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fca090e00/0x5ccaaf4f3cb1ec73 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bf32 expref: 12 pid: 14235 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401058.243044:0:14226:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d6fc138e200/0x5ccaaf4f3cb1ecd5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401058.243052:0:14226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc138e200/0x5ccaaf4f3cb1ecd5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401058.243069:0:14226:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fc138e200/0x5ccaaf4f3cb1ecd5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401058.243076:0:14226:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fc138e200/0x5ccaaf4f3cb1ecd5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401058.243083:0:14226:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d6fc138e200/0x5ccaaf4f3cb1ecd5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401058.243380:0:14226:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d6fc138e200/0x5ccaaf4f3cb1ecd5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401058.243387:0:14226:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138e200 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:0.0:1786401058.243393:0:14226:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d6fc138e200/0x5ccaaf4f3cb1ecd5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401058.243402:0:14226:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d6fc138e200/0x5ccaaf4f3cb1ecd5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401058.243537:0:16255:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d6fc138e200/0x5ccaaf4f3cb1ecd5 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401058.243546:0:16255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d6fc138e200/0x5ccaaf4f3cb1ecd5 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401058.244928:0:14226:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d6fc138e200/0x5ccaaf4f3cb1ecd5 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401058.245306:0:14226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc138e200/0x5ccaaf4f3cb1ecd5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401058.245344:0:14226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786401058.245564:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a470e8d0-b507-45e2-885f-f3cf1de83cf7+11:2364:x1873176850185344:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 3101us (4032us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401058.245577:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 8 00010000:00010000:0.0:1786401058.479806:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786401059.055491:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fefd26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872193024:0@lo:400:kworker.0 00000100:00100000:0.0:1786401059.055590:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401059.055653:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fefd27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873176872193536:0@lo:400:kworker.0 00000100:00100000:0.0:1786401059.055681:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401059.055707:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1786401059.055713:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fefd24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:054a13af-ec40-49d6-93c2-21045d196afe:3309:1873176872192896:0@lo:400:kworker.0 00000100:00100000:0.0:1786401059.055756:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401059.055781:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fefd24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873176872193408:0@lo:400:kworker.0 00000100:00100000:0.0:1786401059.055804:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401059.055831:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fefd26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872193152:0@lo:400:kworker.0 00000100:00100000:0.0:1786401059.055854:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401059.055870:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1786401059.055875:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fefd24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872193280:0@lo:400:kworker.0 00000100:00100000:0.0:1786401059.055894:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401059.055920:0:14877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872193024 00000100:00100000:0.0:1786401059.055928:0:14877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872193024 00000100:00100000:0.0:1786401059.055987:0:14877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872193152 00000100:00100000:0.0:1786401059.055992:0:14877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872193152 00000100:00100000:0.0:1786401059.056010:0:14877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1786401059.056020:0:14877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fefd25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872193024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786401059.056122:0:14877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fefd25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872193024:12345-0@lo:400:kworker.0 Request processed in 103us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401059.056129:0:14877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1786401059.056150:0:14877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1786401059.056155:0:14877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872193152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786401059.056181:0:14877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872193152:12345-0@lo:400:kworker.0 Request processed in 26us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401059.056186:0:14877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1786401059.056206:0:14902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872193536 00000100:00100000:0.0:1786401059.056209:0:14902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872193536 00000100:00100000:0.0:1786401059.056235:0:14902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872193408 00000100:00100000:0.0:1786401059.056237:0:14902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872193408 00000100:00100000:0.0:1786401059.056248:0:14902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872193280 00000100:00100000:0.0:1786401059.056250:0:14902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872193280 00000100:00100000:0.0:1786401059.056260:0:14902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1786401059.056265:0:14902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fefd26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873176872193536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786401059.056289:0:14902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fefd26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873176872193536:12345-0@lo:400:kworker.0 Request processed in 25us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401059.056294:0:14902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1786401059.056304:0:14902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1786401059.056308:0:14902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873176872193408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786401059.056330:0:14902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873176872193408:12345-0@lo:400:kworker.0 Request processed in 21us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401059.056334:0:14902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1786401059.056343:0:14902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1786401059.056347:0:14902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872193280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1786401059.056380:0:14902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872193280:12345-0@lo:400:kworker.0 Request processed in 33us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401059.056385:0:14902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1786401059.056406:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1786401059.056411:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1786401059.056412:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1786401059.056447:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fefd24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872193280:0@lo:400:kworker.0 00000100:00100000:0.0:1786401059.056456:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fefd26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872193152:0@lo:400:kworker.0 00000100:00100000:0.0:1786401059.056485:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fefd24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873176872193408:0@lo:400:kworker.0 00000100:00100000:0.0:1786401059.056493:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fefd26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872193024:0@lo:400:kworker.0 00000100:00100000:0.0:1786401059.056501:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fefd27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873176872193536:0@lo:400:kworker.0 00000100:00100000:3.0:1786401059.057452:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786401059.057470:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872193664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1786401059.057526:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786401059.057614:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872192896 00000100:00100000:3.0:1786401059.057620:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872192896 00000100:00100000:3.0:1786401059.057665:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1786401059.057673:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+16:3309:x1873176872192896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786401059.057717:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+16:3309:x1873176872192896:12345-0@lo:400:kworker.0 Request processed in 45us (1961us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401059.057723:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1786401059.057879:0:14881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872193664 00000100:00100000:1.0:1786401059.057884:0:14881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872193664 00000100:00100000:1.0:1786401059.057914:0:14881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1786401059.057920:0:14881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd891880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872193664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786401059.057953:0:14881:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786401059.058025:0:14881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd891880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872193664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401059.058032:0:14881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1786401059.058161:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fefd24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:054a13af-ec40-49d6-93c2-21045d196afe:3309:1873176872192896:0@lo:400:kworker.0 00000100:00100000:3.0:1786401059.058205:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872193664:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1786401059.505942:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786401059.568242:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786401059.573407:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872193792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1786401059.573562:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401059.573800:0:14881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872193792 00000100:00100000:1.0:1786401059.573810:0:14881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872193792 00000100:00100000:1.0:1786401059.573914:0:14881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1786401059.573925:0:14881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872193792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1786401059.573965:0:14881:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1786401059.574025:0:14881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872193792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401059.574032:0:14881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1786401059.574520:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872193792:0@lo:13:osp-pre-0-0.0 10000000:01000000:3.0:1786401059.698598:0:14238:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1786401059.698606:0:14238:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6fc28ea000 from 10 10000000:01000000:3.0:1786401059.698611:0:14238:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1786401059.698744:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fca090a00/0x5ccaaf4f3cb1ecdc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401059.698757:0:14238:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fca090a00/0x5ccaaf4f3cb1ecdc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401059.698768:0:14238:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fca090a00/0x5ccaaf4f3cb1ecdc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786401059.698795:0:14238:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd891180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:054a13af-ec40-49d6-93c2-21045d196afe:14238:1873176872193920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786401059.698863:0:14238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786401059.699865:0:14238:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc56b03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786401059.708240:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872193920 00000100:00100000:1.0:1786401059.708253:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872193920 00000100:00100000:1.0:1786401059.708325:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1786401059.708333:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+16:14238:x1873176872193920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786401059.708349:0:14236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786401059.708371:0:14236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fc138e600/0x5ccaaf4f3cb1ece3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1ecdc expref: -99 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401059.708397:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc138e600/0x5ccaaf4f3cb1ece3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1ecdc expref: 17 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401059.708407:0:14236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fc138e600/0x5ccaaf4f3cb1ece3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1ecdc expref: 17 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401059.708416:0:14236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138e600, rc 0) 00000100:00100000:1.0:1786401059.708503:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+17:14238:x1873176872193920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (9639us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401059.708522:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1786401059.709264:0:14238:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd891180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:054a13af-ec40-49d6-93c2-21045d196afe:14238:1873176872193920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786401059.709548:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fca090a00/0x5ccaaf4f3cb1ecdc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1ece3 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401059.709560:0:14238:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fca090a00/0x5ccaaf4f3cb1ecdc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1ece3 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786401059.709808:0:14238:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:054a13af-ec40-49d6-93c2-21045d196afe:14238:1873176872194048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786401059.709857:0:14238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401059.709897:0:14238:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc34ea300 going to sleep for 11 seconds 00000100:00100000:1.0:1786401059.709917:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872194048 00000100:00100000:1.0:1786401059.709922:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872194048 00000100:00100000:1.0:1786401059.709954:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1786401059.709962:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+17:14238:x1873176872194048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786401059.710245:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+17:14238:x1873176872194048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 283us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401059.710252:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1786401059.710286:0:14238:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:054a13af-ec40-49d6-93c2-21045d196afe:14238:1873176872194048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786401059.710325:0:14238:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:054a13af-ec40-49d6-93c2-21045d196afe:14238:1873176872194176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786401059.710363:0:14238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401059.710376:0:14238:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc34ea300 going to sleep for 11 seconds 00000100:00100000:1.0:1786401059.710387:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872194176 00000100:00100000:1.0:1786401059.710390:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872194176 00000100:00100000:1.0:1786401059.710405:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1786401059.710902:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+17:14238:x1873176872194176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786401059.711061:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+17:14238:x1873176872194176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401059.711068:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1786401059.711196:0:14238:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:054a13af-ec40-49d6-93c2-21045d196afe:14238:1873176872194176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1786401059.718012:0:16318:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1786401059.718113:0:14238:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1786401059.718888:0:14238:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1786401059.718901:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fca090a00/0x5ccaaf4f3cb1ecdc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1ece3 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401059.718913:0:14238:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fca090a00/0x5ccaaf4f3cb1ecdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1ece3 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1786401059.718923:0:14238:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1786401059.718926:0:14238:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6feddc7000 from 10 10000000:01000000:0.0:1786401059.718929:0:14238:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1786401059.718966:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1ecea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401059.718975:0:14238:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1ecea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401059.718993:0:14238:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1ecea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786401059.719017:0:14238:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:054a13af-ec40-49d6-93c2-21045d196afe:14238:1873176872194304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1786401059.719080:0:14238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401059.719235:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872194304 00000100:00100000:1.0:1786401059.719242:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872194304 00000100:00100000:1.0:1786401059.719288:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1786401059.719299:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+17:14238:x1873176872194304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1786401059.719315:0:14235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786401059.719328:0:14235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fc138e200/0x5ccaaf4f3cb1ecf1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1ecea expref: -99 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401059.719353:0:14235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc138e200/0x5ccaaf4f3cb1ecf1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1ecea expref: 18 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401059.719364:0:14235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fc138e200/0x5ccaaf4f3cb1ecf1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1ecea expref: 18 pid: 14235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401059.719374:0:14235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138e200, rc 0) 00000100:00100000:1.0:1786401059.719413:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+18:14238:x1873176872194304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401059.719420:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1786401059.719549:0:14238:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fff87d900 going to sleep for 11 seconds 00000100:00100000:0.0:1786401059.719573:0:14238:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:054a13af-ec40-49d6-93c2-21045d196afe:14238:1873176872194304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1786401059.719587:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1ecea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1ecf1 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401059.719596:0:14238:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1ecea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1ecf1 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786401059.719714:0:14238:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:054a13af-ec40-49d6-93c2-21045d196afe:14238:1873176872194432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786401059.719752:0:14238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401059.719767:0:14238:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fff87d900 going to sleep for 11 seconds 00000100:00100000:3.0:1786401059.720411:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872194432 00000100:00100000:3.0:1786401059.720419:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872194432 00000100:00100000:3.0:1786401059.720535:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1786401059.720610:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+18:14238:x1873176872194432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786401059.720894:0:14238:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:054a13af-ec40-49d6-93c2-21045d196afe:14238:1873176872194432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1786401059.720928:0:14238:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:054a13af-ec40-49d6-93c2-21045d196afe:14238:1873176872194560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786401059.720958:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+18:14238:x1873176872194432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 413us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401059.720966:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1786401059.720974:0:14238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786401059.720999:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872194560 00000100:00100000:3.0:1786401059.721004:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872194560 00000100:00100000:3.0:1786401059.721019:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1786401059.721025:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+18:14238:x1873176872194560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786401059.721234:0:14238:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fff87d900 going to sleep for 11 seconds 00000100:00100000:3.0:1786401059.721240:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+18:14238:x1873176872194560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 213us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401059.721250:0:14238:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:054a13af-ec40-49d6-93c2-21045d196afe:14238:1873176872194560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1786401059.721251:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000040:00080000:3.0:1786401059.722766:0:16320:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1786401059.723028:0:14238:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1786401059.723050:0:14238:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1786401059.723061:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1ecea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1ecf1 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401059.723072:0:14238:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6ffd5aa200/0x5ccaaf4f3cb1ecea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1ecf1 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1786401059.723082:0:14238:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1786401059.723105:0:14238:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6ec4cf8800 from 10 10000000:01000000:3.0:1786401059.723109:0:14238:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1786401059.723140:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fca090000/0x5ccaaf4f3cb1ecf8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401059.723159:0:14238:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.108@tcp lock: ffff9d6fca090000/0x5ccaaf4f3cb1ecf8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401059.723170:0:14238:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.108@tcp lock: ffff9d6fca090000/0x5ccaaf4f3cb1ecf8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786401059.723192:0:14238:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd893800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:054a13af-ec40-49d6-93c2-21045d196afe:14238:1873176872194688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1786401059.723244:0:14238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786401059.723277:0:14238:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc56b0000 going to sleep for 11 seconds 00000100:00100000:3.0:1786401059.723295:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872194688 00000100:00100000:3.0:1786401059.723300:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872194688 00000100:00100000:3.0:1786401059.723425:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1786401059.723520:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+18:14238:x1873176872194688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786401059.723532:0:14233:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786401059.723615:0:14233:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fca091400/0x5ccaaf4f3cb1ecff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ccaaf4f3cb1ecf8 expref: -99 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401059.723640:0:14233:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fca091400/0x5ccaaf4f3cb1ecff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1ecf8 expref: 19 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401059.723650:0:14233:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fca091400/0x5ccaaf4f3cb1ecff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5ccaaf4f3cb1ecf8 expref: 19 pid: 14233 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401059.723659:0:14233:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca091400, rc 0) 00000100:00100000:3.0:1786401059.723707:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:054a13af-ec40-49d6-93c2-21045d196afe+19:14238:x1873176872194688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401059.723716:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1786401059.723787:0:14238:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd893800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:054a13af-ec40-49d6-93c2-21045d196afe:14238:1873176872194688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786401059.723802:0:14238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.108@tcp lock: ffff9d6fca090000/0x5ccaaf4f3cb1ecf8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1ecff expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401059.723812:0:14238:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.108@tcp lock: ffff9d6fca090000/0x5ccaaf4f3cb1ecf8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5ccaaf4f3cb1ecff expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786401059.723856:0:14238:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd893800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:054a13af-ec40-49d6-93c2-21045d196afe:14238:1873176872194816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786401059.723948:0:14238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786401059.723972:0:14238:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc56b0000 going to sleep for 11 seconds 00000100:00100000:3.0:1786401059.727011:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872194816 00000100:00100000:3.0:1786401059.727022:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872194816 00000100:00100000:3.0:1786401059.727161:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1786401059.727172:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4806850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+19:14238:x1873176872194816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786401059.727718:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4806850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:054a13af-ec40-49d6-93c2-21045d196afe+19:14238:x1873176872194816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 547us (3767us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401059.727739:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1786401059.728251:0:14238:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd893800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:054a13af-ec40-49d6-93c2-21045d196afe:14238:1873176872194816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1786401059.728306:0:14238:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffde22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:054a13af-ec40-49d6-93c2-21045d196afe:14238:1873176872194944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786401059.728355:0:14238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401059.728390:0:14238:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc34ea3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786401059.728405:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872194944 00000100:00100000:1.0:1786401059.728410:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872194944 00000100:00100000:1.0:1786401059.728438:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1786401059.728444:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+19:14238:x1873176872194944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1786401059.732558:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+19:14238:x1873176872194944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1994us (2083us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401059.732579:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1786401059.733203:0:14238:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffde22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:054a13af-ec40-49d6-93c2-21045d196afe:14238:1873176872194944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1786401059.736051:0:16322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1786401059.737307:0:14238:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1786401059.737337:0:14238:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.108@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1786401059.737349:0:14238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff9d6fca090000/0x5ccaaf4f3cb1ecf8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1ecff expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401059.737363:0:14238:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.108@tcp lock: ffff9d6fca090000/0x5ccaaf4f3cb1ecf8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5ccaaf4f3cb1ecff expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786401059.762063:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401059.764071:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850185472 00000100:00100000:3.0:1786401059.764099:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850185472 00000100:00100000:3.0:1786401059.764160:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 114 00000100:00100000:3.0:1786401059.764171:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a470e8d0-b507-45e2-885f-f3cf1de83cf7+11:13733:x1873176850185472:12345-192.168.204.8@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1786401059.764190:0:14236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786401059.764209:0:14236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fca091000/0x5ccaaf4f3cb1ed06 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bfc5 expref: -99 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401059.764238:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fca091000/0x5ccaaf4f3cb1ed06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bfc5 expref: 12 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401059.764263:0:14236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fca091000/0x5ccaaf4f3cb1ed06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bfc5 expref: 12 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401059.764274:0:14236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fca091000, rc 0) 00000100:00100000:3.0:1786401059.764337:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a470e8d0-b507-45e2-885f-f3cf1de83cf7+12:13733:x1873176850185472:12345-192.168.204.8@tcp:101:ll_cfg_requeue.0 Request processed in 167us (2474us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401059.764344:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 114 00000100:00100000:3.0:1786401059.770415:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401059.770466:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850185600 00000100:00100000:3.0:1786401059.770476:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850185600 00000100:00100000:3.0:1786401059.770528:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 115 00000100:00100000:3.0:1786401059.770537:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a470e8d0-b507-45e2-885f-f3cf1de83cf7+12:13733:x1873176850185600:12345-192.168.204.8@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786401059.772017:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a470e8d0-b507-45e2-885f-f3cf1de83cf7+12:13733:x1873176850185600:12345-192.168.204.8@tcp:501:ll_cfg_requeue.0 Request processed in 1474us (1605us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401059.772028:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 115 00000100:00100000:0.0:1786401059.780785:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786401059.785332:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850185728 00000100:00100000:2.0:1786401059.785346:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850185728 00000100:00100000:2.0:1786401059.785414:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 116 00000100:00100000:2.0:1786401059.785428:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a470e8d0-b507-45e2-885f-f3cf1de83cf7+12:13733:x1873176850185728:12345-192.168.204.8@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1786401059.785689:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a470e8d0-b507-45e2-885f-f3cf1de83cf7+12:13733:x1873176850185728:12345-192.168.204.8@tcp:503:ll_cfg_requeue.0 Request processed in 265us (4915us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401059.785696:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 116 00000100:00100000:3.0:1786401059.806615:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786401059.807392:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850185856 00000100:00100000:2.0:1786401059.807403:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850185856 00000100:00100000:2.0:1786401059.807473:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 117 00000100:00100000:2.0:1786401059.807484:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a470e8d0-b507-45e2-885f-f3cf1de83cf7+12:13733:x1873176850185856:12345-192.168.204.8@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1786401059.807526:0:14236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786401059.807545:0:14236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fc4e5d800/0x5ccaaf4f3cb1ed0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bfcc expref: -99 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401059.807574:0:14236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc4e5d800/0x5ccaaf4f3cb1ed0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bfcc expref: 13 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401059.807586:0:14236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fc4e5d800/0x5ccaaf4f3cb1ed0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bfcc expref: 13 pid: 14236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401059.807594:0:14236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc4e5d800, rc 0) 00000100:00100000:2.0:1786401059.807666:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a470e8d0-b507-45e2-885f-f3cf1de83cf7+13:13733:x1873176850185856:12345-192.168.204.8@tcp:101:ll_cfg_requeue.0 Request processed in 183us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401059.807675:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 117 00000100:00100000:2.0:1786401059.810701:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401059.810786:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850185984 00000100:00100000:3.0:1786401059.810797:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850185984 00000100:00100000:3.0:1786401059.810851:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 118 00000100:00100000:3.0:1786401059.810862:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a470e8d0-b507-45e2-885f-f3cf1de83cf7+13:13733:x1873176850185984:12345-192.168.204.8@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1786401059.811452:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a470e8d0-b507-45e2-885f-f3cf1de83cf7+13:13733:x1873176850185984:12345-192.168.204.8@tcp:501:ll_cfg_requeue.0 Request processed in 589us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401059.811462:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 118 00000100:00100000:2.0:1786401059.818355:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401059.827360:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850186112 00000100:00100000:0.0:1786401059.827392:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850186112 00000100:00100000:0.0:1786401059.827510:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 119 00000100:00100000:0.0:1786401059.827522:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a470e8d0-b507-45e2-885f-f3cf1de83cf7+13:13733:x1873176850186112:12345-192.168.204.8@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1786401059.828386:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a470e8d0-b507-45e2-885f-f3cf1de83cf7+13:13733:x1873176850186112:12345-192.168.204.8@tcp:503:ll_cfg_requeue.0 Request processed in 863us (10038us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401059.828396:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 119 00000040:00080000:2.0:1786401060.078758:0:14275:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1786401060.527443:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786401060.914385:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786401060.914574:0:14236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850186240 00000100:00100000:2.0:1786401060.914586:0:14236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850186240 00000100:00100000:2.0:1786401060.914652:0:14236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 120 00000100:00100000:2.0:1786401060.914663:0:14236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a470e8d0-b507-45e2-885f-f3cf1de83cf7+13:2365:x1873176850186240:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:2.0:1786401060.914763:0:14236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a470e8d0-b507-45e2-885f-f3cf1de83cf7+13:2365:x1873176850186240:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 100us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401060.914770:0:14236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 120 00000100:00100000:3.0:1786401060.915184:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401060.915315:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401060.915340:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401060.915359:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401060.915379:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401060.915398:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401060.915415:0:14902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850186752 00000100:00100000:3.0:1786401060.915420:0:14902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850186752 00000100:00100000:3.0:1786401060.915466:0:14902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850186368 00000100:00100000:3.0:1786401060.915469:0:14902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850186368 00000100:00100000:3.0:1786401060.915489:0:14902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 24 00000100:00100000:3.0:1786401060.915496:0:14902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9366b5e6-e19b-4a08-b543-2a32b0307b57+6:2365:x1873176850186752:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:3.0:1786401060.915538:0:14902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9366b5e6-e19b-4a08-b543-2a32b0307b57+6:2365:x1873176850186752:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 42us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401060.915544:0:14902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 24 00000100:00100000:3.0:1786401060.915556:0:14902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 25 00000100:00100000:3.0:1786401060.915562:0:14902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd893100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cedfe83e-8f3e-46c2-8429-f823952ad440+6:2365:x1873176850186368:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:3.0:1786401060.915583:0:14902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd893100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cedfe83e-8f3e-46c2-8429-f823952ad440+6:2365:x1873176850186368:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 21us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401060.915589:0:14902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 25 00000100:00100000:3.0:1786401060.915607:0:14878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850186496 00000100:00100000:3.0:1786401060.915610:0:14878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850186496 00000100:00100000:3.0:1786401060.915628:0:14878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850187008 00000100:00100000:3.0:1786401060.915631:0:14878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850187008 00000100:00100000:3.0:1786401060.915641:0:14878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850186624 00000100:00100000:3.0:1786401060.915643:0:14878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850186624 00000100:00100000:3.0:1786401060.915652:0:14878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850186880 00000100:00100000:3.0:1786401060.915654:0:14878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850186880 00000100:00100000:3.0:1786401060.915666:0:14878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 12 00000100:00100000:3.0:1786401060.915679:0:14878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd891c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+5:2365:x1873176850186496:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:3.0:1786401060.915715:0:14878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd891c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+5:2365:x1873176850186496:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 27us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401060.915722:0:14878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 12 00000100:00100000:3.0:1786401060.915734:0:14878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 13 00000100:00100000:3.0:1786401060.915740:0:14878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd890a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9366b5e6-e19b-4a08-b543-2a32b0307b57+5:2365:x1873176850187008:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:3.0:1786401060.915763:0:14878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd890a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9366b5e6-e19b-4a08-b543-2a32b0307b57+5:2365:x1873176850187008:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 24us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401060.915769:0:14878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 13 00000100:00100000:3.0:1786401060.915778:0:14878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14 00000100:00100000:3.0:1786401060.915784:0:14878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd890700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+5:2365:x1873176850186624:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:3.0:1786401060.915803:0:14878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd890700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+5:2365:x1873176850186624:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 19us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401060.915808:0:14878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14 00000100:00100000:3.0:1786401060.915818:0:14878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 15 00000100:00100000:3.0:1786401060.915824:0:14878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd892680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9366b5e6-e19b-4a08-b543-2a32b0307b57+5:2365:x1873176850186880:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:3.0:1786401060.915847:0:14878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd892680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9366b5e6-e19b-4a08-b543-2a32b0307b57+5:2365:x1873176850186880:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 24us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401060.915853:0:14878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 15 00000100:00080000:3.0:1786401060.915875:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1786401060.915879:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1786401060.915882:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1786401061.550265:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786401061.947629:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401061.948312:0:14902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850187136 00000100:00100000:0.0:1786401061.948451:0:14902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850187136 00000100:00100000:0.0:1786401061.948647:0:14902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 15 00000100:00100000:0.0:1786401061.948661:0:14902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd893800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cedfe83e-8f3e-46c2-8429-f823952ad440+6:14390:x1873176850187136:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786401061.948705:0:14902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786401061.948737:0:14902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1ed14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bfd3 expref: -99 pid: 14902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401061.949288:0:14902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1ed1b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401061.949309:0:14902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1ed1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401061.949401:0:14902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1ed1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401061.949734:0:14902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1ed22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401061.949743:0:14902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1ed22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401061.949775:0:14902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1ed22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401061.950977:0:14902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1ed29 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401061.950998:0:14902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1ed29 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401061.951011:0:14902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1ed29 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786401061.951150:0:14902:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1786401061.951157:0:14902:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1786401061.951269:0:14902:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1ed29 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401061.951284:0:14902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1ed1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401061.951291:0:14902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1ed1b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401061.951299:0:14902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1ed1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401061.951305:0:14902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aa800 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786401061.951311:0:14902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1ed1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401061.951335:0:14902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1ed1b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401061.951359:0:14902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fc90cdf00) 00010000:00010000:0.0:1786401061.951362:0:14902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786401061.951368:0:14902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1ed1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401061.951374:0:14902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1ed1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401061.951390:0:14902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1ed22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401061.951396:0:14902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1ed22 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401061.952505:0:14902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1ed22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401061.952538:0:14902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5ab600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786401061.952544:0:14902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1ed22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401061.952553:0:14902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1ed22 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401061.952572:0:14902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9d6fc90cdc00) 00010000:00010000:0.0:1786401061.952574:0:14902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786401061.952587:0:14902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1ed22 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401061.952595:0:14902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1ed22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401061.952701:0:14902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1ed14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bfd3 expref: 8 pid: 14902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401061.952719:0:14902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa600/0x5ccaaf4f3cb1ed29 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bfd3 expref: 7 pid: 14902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401061.952727:0:14902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d6fc90cda00) 00010000:00010000:0.0:1786401061.952729:0:14902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786401061.952731:0:14902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5aa600, rc 0) 00000100:00100000:0.0:1786401061.954490:0:14902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd893800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cedfe83e-8f3e-46c2-8429-f823952ad440+7:14390:x1873176850187136:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 5816us (6861us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401061.954508:0:14902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 15 00000100:00100000:2.0:1786401061.966554:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401061.966870:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850187392 00000100:00100000:3.0:1786401061.966904:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850187392 00000100:00100000:3.0:1786401061.966982:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 16 00000100:00100000:3.0:1786401061.966994:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+7:14390:x1873176850187392:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786401061.967023:0:14243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786401061.967055:0:14243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090800/0x5ccaaf4f3cb1ed30 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bfda expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401061.967682:0:14243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1ed37 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401061.967714:0:14243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1ed37 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401061.967730:0:14243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1ed37 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401061.971741:0:14243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1ed3e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401061.971767:0:14243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1ed3e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401061.971781:0:14243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1ed3e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401061.976197:0:14243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d200/0x5ccaaf4f3cb1ed45 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401061.976237:0:14243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d200/0x5ccaaf4f3cb1ed45 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401061.976254:0:14243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d200/0x5ccaaf4f3cb1ed45 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786401061.976270:0:14243:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1786401061.980312:0:14243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1ed37 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401061.982681:0:14243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1ed37 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401061.982704:0:14243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1ed37 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401061.982712:0:14243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca090e00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786401061.982719:0:14243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1ed37 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401061.982732:0:14243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1ed37 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401061.982757:0:14243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d6fc90cda00) 00010000:00010000:2.0:1786401061.982761:0:14243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786401061.982767:0:14243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1ed37 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401061.982776:0:14243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090e00/0x5ccaaf4f3cb1ed37 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401061.982801:0:14243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1ed3e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401061.982835:0:14243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1ed3e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401061.982841:0:14243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1ed3e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401061.982845:0:14243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fca091800 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786401061.982847:0:14243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1ed3e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401061.982853:0:14243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1ed3e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401061.982861:0:14243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9d6fc5599e00) 00010000:00010000:2.0:1786401061.982864:0:14243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786401061.982867:0:14243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1ed3e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401061.982874:0:14243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca091800/0x5ccaaf4f3cb1ed3e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401061.985731:0:14243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fca090800/0x5ccaaf4f3cb1ed30 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bfda expref: 10 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401061.985773:0:14243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d200/0x5ccaaf4f3cb1ed45 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bfda expref: 9 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401061.985783:0:14243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d6fc2ed7300) 00010000:00010000:2.0:1786401061.985786:0:14243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786401061.985812:0:14243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc4e5d200, rc 0) 00000100:00100000:2.0:1786401061.985931:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+9:14390:x1873176850187392:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 18937us (19395us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1786401061.985943:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 16 00000100:00100000:1.0:1786401062.000586:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401062.001236:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850187520 00000100:00100000:3.0:1786401062.001251:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850187520 00000100:00100000:3.0:1786401062.001651:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 17 00000100:00100000:3.0:1786401062.001667:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+9:14390:x1873176850187520:12345-192.168.204.8@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1786401062.001838:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+9:14390:x1873176850187520:12345-192.168.204.8@tcp:59:lhsmtool_posix.0 Request processed in 175us (1266us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401062.001865:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 17 00000100:00080000:0.0:1786401062.006665:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1786401062.076734:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401062.077476:0:14241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850187648 00000100:00100000:0.0:1786401062.077487:0:14241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850187648 00000100:00100000:0.0:1786401062.077628:0:14241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 18 00000100:00100000:0.0:1786401062.077639:0:14241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd891180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cedfe83e-8f3e-46c2-8429-f823952ad440+9:14396:x1873176850187648:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:0.0:1786401062.077660:0:14241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786401062.077822:0:14241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1ed53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bfe1 expref: -99 pid: 14241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.078146:0:14241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1ed5a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.078162:0:14241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1ed5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.078193:0:14241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1ed5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.078209:0:14241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1ed61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.078216:0:14241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1ed61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.078223:0:14241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1ed61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.079037:0:14241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1ed5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.079049:0:14241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1ed5a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.079056:0:14241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1ed5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.079061:0:14241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5ab600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786401062.079066:0:14241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1ed5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.079074:0:14241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1ed5a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.079114:0:14241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fc90cdf00) 00010000:00010000:0.0:1786401062.079118:0:14241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786401062.079122:0:14241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1ed5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.079135:0:14241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1ed5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.079148:0:14241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1ed61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.079155:0:14241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1ed61 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.079159:0:14241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1ed61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.079164:0:14241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aa800 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786401062.079167:0:14241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1ed61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.079172:0:14241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1ed61 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.079181:0:14241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d6fc90cdc00) 00010000:00010000:0.0:1786401062.079183:0:14241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786401062.079186:0:14241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1ed61 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.079190:0:14241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1ed61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.079232:0:14241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1ed53 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bfe1 expref: 10 pid: 14241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.079254:0:14241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fc90cdf00) 00010000:00010000:0.0:1786401062.079256:0:14241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786401062.079260:0:14241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1ed53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bfe1 expref: 10 pid: 14241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.079270:0:14241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5aaa00, rc 0) 00000100:00100000:0.0:1786401062.079333:0:14241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd891180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cedfe83e-8f3e-46c2-8429-f823952ad440+9:14396:x1873176850187648:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 1695us (2609us total) trans 0 rc 301/301 00000100:00100000:0.0:1786401062.079341:0:14241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 18 00000100:00100000:2.0:1786401062.092381:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401062.092491:0:14250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850187776 00000100:00100000:3.0:1786401062.092501:0:14250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850187776 00000100:00100000:3.0:1786401062.092975:0:14250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 0 00000100:00100000:3.0:1786401062.092988:0:14250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:cedfe83e-8f3e-46c2-8429-f823952ad440+9:14396:x1873176850187776:12345-192.168.204.8@tcp:700:lfs.0 00000100:00100000:3.0:1786401062.093120:0:14250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:cedfe83e-8f3e-46c2-8429-f823952ad440+9:14396:x1873176850187776:12345-192.168.204.8@tcp:700:lfs.0 Request processed in 135us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401062.093129:0:14250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 0 00000100:00100000:1.0:1786401062.096961:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401062.097326:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850188032 00000100:00100000:3.0:1786401062.097336:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850188032 00000100:00100000:3.0:1786401062.097878:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 19 00000100:00100000:3.0:1786401062.097975:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+9:14396:x1873176850188032:12345-192.168.204.8@tcp:36:lfs.0 00010000:00010000:3.0:1786401062.098037:0:14242:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786401062.098067:0:14242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1ec96 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bf5c expref: 9 pid: 14902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.098125:0:14242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fc90cdf00) 00010000:00010000:3.0:1786401062.098131:0:14242:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786401062.099169:0:14242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1ed68 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.099189:0:14242:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5abe00/0x5ccaaf4f3cb1ecce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bfbe expref: 5 pid: 14902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.099198:0:14242:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1ed68 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.099254:0:14242:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5abe00/0x5ccaaf4f3cb1ecce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bfbe expref: 5 pid: 14902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.099272:0:14242:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5abe00/0x5ccaaf4f3cb1ecce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bfbe expref: 5 pid: 14902 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786401062.099287:0:14242:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffd890380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14242:1873176872195072:192.168.204.8@tcp:104: 00000100:00100000:3.0:1786401062.099381:0:14242:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc56b06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1786401062.105782:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401062.106004:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850188160 00000100:00100000:0.0:1786401062.106015:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850188160 00010000:00010000:0.0:1786401062.106072:0:14227:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5abe00/0x5ccaaf4f3cb1ecce lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bfbe expref: 6 pid: 14902 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786401062.106122:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 9 00000100:00100000:0.0:1786401062.106133:0:14227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9366b5e6-e19b-4a08-b543-2a32b0307b57+6:2365:x1873176850188160:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786401062.106148:0:14227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786401062.106155:0:14227:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5abe00/0x5ccaaf4f3cb1ecce lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bfbe expref: 6 pid: 14902 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.106168:0:14227:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5abe00/0x5ccaaf4f3cb1ecce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bfbe expref: 6 pid: 14902 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.106192:0:14227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fc90cdf00) 00010000:00010000:0.0:1786401062.106197:0:14227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1ed68 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.106222:0:14227:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1ed68 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.106229:0:14227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1ed68 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.106255:0:14227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786401062.106305:0:14227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9366b5e6-e19b-4a08-b543-2a32b0307b57+6:2365:x1873176850188160:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 174us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401062.106312:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 9 00000100:00080000:1.0:1786401062.107130:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1786401062.108143:0:14242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5abe00/0x5ccaaf4f3cb1ecce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bfbe expref: 5 pid: 14902 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786401062.108165:0:14242:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffd890380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14242:1873176872195072:192.168.204.8@tcp:104: 00010000:00010000:3.0:1786401062.108187:0:14242:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1ed68 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.108197:0:14242:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1ed68 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.108203:0:14242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1ed68 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.108232:0:14242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5800/0x5ccaaf4f3cb1ed6f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.108244:0:14242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5800/0x5ccaaf4f3cb1ed6f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.108253:0:14242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5800/0x5ccaaf4f3cb1ed6f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786401062.116977:0:14242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1786401062.116999:0:14242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1ed68 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.117011:0:14242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1ed68 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.117019:0:14242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1ed68 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.117025:0:14242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d70020e4200 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786401062.117030:0:14242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1ed68 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.117038:0:14242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1ed68 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.117056:0:14242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fc90cdf00) 00010000:00010000:3.0:1786401062.117059:0:14242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786401062.117064:0:14242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1ed68 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.117070:0:14242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1ed68 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786401062.117192:0:14242:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007337d737 reply state 000000005f43d597 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5800/0x5ccaaf4f3cb1ed6f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786401062.117203:0:14242:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786401062.117605:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+10:14396:x1873176850188032:12345-192.168.204.8@tcp:36:lfs.0 Request processed in 19713us (21038us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1786401062.117635:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 19 00000040:00080000:2.0:1786401062.127297:0:14275:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1786401062.129629:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5800/0x5ccaaf4f3cb1ed6f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401062.129647:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5800/0x5ccaaf4f3cb1ed6f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401062.129656:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5800/0x5ccaaf4f3cb1ed6f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401062.129662:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d70020e5800 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786401062.129667:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5800/0x5ccaaf4f3cb1ed6f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401062.129756:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5800/0x5ccaaf4f3cb1ed6f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401062.129775:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d6fc5599b00) 00010000:00010000:2.0:1786401062.129778:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786401062.129783:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5800/0x5ccaaf4f3cb1ed6f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401062.129789:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5800/0x5ccaaf4f3cb1ed6f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786401062.254061:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786401062.254352:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850188288 00000100:00100000:2.0:1786401062.254380:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850188288 00000100:00100000:2.0:1786401062.254795:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 20 00000100:00100000:2.0:1786401062.254807:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+9:14404:x1873176850188288:12345-192.168.204.8@tcp:101:lctl.0 00010000:00010000:2.0:1786401062.254836:0:14243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786401062.254863:0:14243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5ce00/0x5ccaaf4f3cb1ed76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bfe8 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401062.254937:0:14243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1ed7d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401062.254951:0:14243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1ed7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401062.254963:0:14243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1ed7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1786401062.255034:0:14243:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1786401062.255038:0:14243:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1786401062.255083:0:14243:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1ed7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401062.255136:0:14243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5ce00/0x5ccaaf4f3cb1ed76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bfe8 expref: 11 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401062.255156:0:14243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d000/0x5ccaaf4f3cb1ed7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bfe8 expref: 10 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401062.255166:0:14243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fc2ed7700) 00010000:00010000:2.0:1786401062.255169:0:14243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1786401062.255172:0:14243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc4e5d000, rc 0) 00000100:00100000:2.0:1786401062.255264:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+10:14404:x1873176850188288:12345-192.168.204.8@tcp:101:lctl.0 Request processed in 460us (1218us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401062.255272:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 20 00000100:00100000:1.0:1786401062.294745:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401062.294875:0:14902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850188416 00000100:00100000:0.0:1786401062.294886:0:14902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850188416 00000100:00100000:0.0:1786401062.295050:0:14902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 21 00000100:00100000:0.0:1786401062.295062:0:14902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9366b5e6-e19b-4a08-b543-2a32b0307b57+5:14405:x1873176850188416:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:0.0:1786401062.295083:0:14902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786401062.295125:0:14902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1ed84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bfef expref: -99 pid: 14902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.295189:0:14902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5abc00/0x5ccaaf4f3cb1ed8b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.295201:0:14902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5abc00/0x5ccaaf4f3cb1ed8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.295213:0:14902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5abc00/0x5ccaaf4f3cb1ed8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786401062.295277:0:14902:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1786401062.295295:0:14902:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1786401062.295325:0:14902:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5abc00/0x5ccaaf4f3cb1ed8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.295351:0:14902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1ed84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bfef expref: 7 pid: 14902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.295369:0:14902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5abc00/0x5ccaaf4f3cb1ed8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bfef expref: 6 pid: 14902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.295378:0:14902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fc2ed7700) 00010000:00010000:0.0:1786401062.295381:0:14902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786401062.295385:0:14902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5abc00, rc 0) 00000100:00100000:0.0:1786401062.295451:0:14902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9366b5e6-e19b-4a08-b543-2a32b0307b57+6:14405:x1873176850188416:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 391us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401062.295459:0:14902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 21 00000100:00100000:1.0:1786401062.304458:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401062.305722:0:14241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850188544 00000100:00100000:0.0:1786401062.305737:0:14241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850188544 00000100:00100000:0.0:1786401062.305811:0:14241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 22 00000100:00100000:0.0:1786401062.305821:0:14241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9366b5e6-e19b-4a08-b543-2a32b0307b57+6:14405:x1873176850188544:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:0.0:1786401062.305843:0:14241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786401062.305865:0:14241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1ed92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bff6 expref: -99 pid: 14241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.305935:0:14241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1ed99 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.305950:0:14241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1ed99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.305980:0:14241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1ed99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.305996:0:14241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1eda0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.306004:0:14241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1eda0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.306010:0:14241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1eda0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.306143:0:14241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1eda7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.306151:0:14241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1eda7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.306157:0:14241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1eda7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786401062.306199:0:14241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1786401062.306204:0:14241:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786401062.306224:0:14241:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1eda7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.306236:0:14241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1ed99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.306242:0:14241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1ed99 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.306257:0:14241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1ed99 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.306262:0:14241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aae00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786401062.306266:0:14241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1ed99 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.306274:0:14241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1ed99 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.306287:0:14241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fc2ed7700) 00010000:00010000:0.0:1786401062.306290:0:14241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786401062.306294:0:14241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1ed99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.306300:0:14241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1ed99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.306314:0:14241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1eda0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.306320:0:14241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1eda0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.306325:0:14241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1eda0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.306330:0:14241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5ab600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786401062.306333:0:14241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1eda0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.306350:0:14241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1eda0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.306360:0:14241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d6fc90cdc00) 00010000:00010000:0.0:1786401062.306362:0:14241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786401062.306365:0:14241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1eda0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.306371:0:14241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1eda0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.306403:0:14241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1ed92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bff6 expref: 8 pid: 14241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.306416:0:14241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1eda7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bff6 expref: 7 pid: 14241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.306423:0:14241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d6fc90cd700) 00010000:00010000:0.0:1786401062.306425:0:14241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786401062.306427:0:14241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5aa800, rc 0) 00000100:00100000:0.0:1786401062.306831:0:14241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9366b5e6-e19b-4a08-b543-2a32b0307b57+7:14405:x1873176850188544:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 1009us (2381us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401062.306839:0:14241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 22 00000100:00100000:1.0:1786401062.315149:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401062.315286:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850188800 00000100:00100000:3.0:1786401062.315296:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850188800 00000100:00100000:3.0:1786401062.315395:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 23 00000100:00100000:3.0:1786401062.315417:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9366b5e6-e19b-4a08-b543-2a32b0307b57+7:14405:x1873176850188800:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:3.0:1786401062.315437:0:14242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786401062.315457:0:14242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1edae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6bffd expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786401062.315576:0:14242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1786401062.315796:0:14242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1edae lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bffd expref: 9 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.315811:0:14242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fc2ed7700) 00010000:00010000:3.0:1786401062.315815:0:14242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786401062.315820:0:14242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1edae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bffd expref: 9 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.315836:0:14242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d70020e4200, rc 0) 00000100:00100000:3.0:1786401062.315900:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9366b5e6-e19b-4a08-b543-2a32b0307b57+8:14405:x1873176850188800:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 484us (759us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1786401062.315908:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 23 00000100:00100000:1.0:1786401062.322280:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786401062.322366:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850189056 00000100:00100000:2.0:1786401062.322375:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850189056 00000100:00100000:2.0:1786401062.322808:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 24 00000100:00100000:2.0:1786401062.322821:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffde20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9366b5e6-e19b-4a08-b543-2a32b0307b57+8:14405:x1873176850189056:12345-192.168.204.8@tcp:36:lfs.0 00010000:00010000:2.0:1786401062.322878:0:14243:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786401062.322905:0:14243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aa800/0x5ccaaf4f3cb1eda7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6bff6 expref: 8 pid: 14241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401062.322939:0:14243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d6fc90cd700) 00010000:00010000:2.0:1786401062.322952:0:14243:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786401062.322978:0:14243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5ce00/0x5ccaaf4f3cb1edbc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401062.322991:0:14243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5ce00/0x5ccaaf4f3cb1edbc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401062.323001:0:14243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5ce00/0x5ccaaf4f3cb1edbc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1786401062.323285:0:14243:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001f98e97f reply state 0000000042ae76a4 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5ce00/0x5ccaaf4f3cb1edbc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786401062.323295:0:14243:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1786401062.323310:0:14243:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1786401062.323389:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffde20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9366b5e6-e19b-4a08-b543-2a32b0307b57+9:14405:x1873176850189056:12345-192.168.204.8@tcp:36:lfs.0 Request processed in 571us (1119us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1786401062.323409:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 24 00010000:00010000:3.0:1786401062.330896:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5ce00/0x5ccaaf4f3cb1edbc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.330915:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5ce00/0x5ccaaf4f3cb1edbc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.330944:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5ce00/0x5ccaaf4f3cb1edbc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.330950:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5ce00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786401062.330955:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5ce00/0x5ccaaf4f3cb1edbc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.330963:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5ce00/0x5ccaaf4f3cb1edbc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.330982:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d6fc2ed7f00) 00010000:00010000:3.0:1786401062.330985:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1786401062.330989:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5ce00/0x5ccaaf4f3cb1edbc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.330995:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5ce00/0x5ccaaf4f3cb1edbc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786401062.331399:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401062.331884:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850189312 00000100:00100000:0.0:1786401062.331895:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850189312 00000100:00100000:0.0:1786401062.331956:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2 00000100:00100000:0.0:1786401062.331966:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9366b5e6-e19b-4a08-b543-2a32b0307b57+8:14405:x1873176850189312:12345-192.168.204.8@tcp:35:lfs.0 00000100:00100000:0.0:1786401062.332898:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9366b5e6-e19b-4a08-b543-2a32b0307b57+9:14405:x1873176850189312:12345-192.168.204.8@tcp:35:lfs.0 Request processed in 929us (1502us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1786401062.332909:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2 00000100:00100000:1.0:1786401062.338242:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401062.338387:0:14902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850189568 00000100:00100000:0.0:1786401062.338399:0:14902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850189568 00000100:00100000:0.0:1786401062.338499:0:14902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 25 00000100:00100000:0.0:1786401062.338520:0:14902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9366b5e6-e19b-4a08-b543-2a32b0307b57+9:14405:x1873176850189568:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:0.0:1786401062.338546:0:14902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786401062.338566:0:14902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1edc3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6c004 expref: -99 pid: 14902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.338847:0:14902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1edca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.338862:0:14902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1edca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.338873:0:14902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1edca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.338886:0:14902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1edd1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.338893:0:14902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1edd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.338900:0:14902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1edd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786401062.339051:0:14902:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1786401062.339208:0:14902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1edca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.339217:0:14902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1edca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.339223:0:14902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1edca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.339229:0:14902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5ab600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786401062.339233:0:14902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1edca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.339240:0:14902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1edca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.339252:0:14902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fc2ed7700) 00010000:00010000:0.0:1786401062.339255:0:14902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786401062.339260:0:14902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1edca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.339265:0:14902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1edca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.339281:0:14902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1edd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.339287:0:14902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1edd1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.339292:0:14902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1edd1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.339307:0:14902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aae00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786401062.339310:0:14902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1edd1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.339316:0:14902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1edd1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.339325:0:14902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d6fc90cdc00) 00010000:00010000:0.0:1786401062.339327:0:14902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786401062.339330:0:14902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1edd1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.339335:0:14902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1edd1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.339375:0:14902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1edc3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c004 expref: 11 pid: 14902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.339386:0:14902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fc2ed7700) 00010000:00010000:0.0:1786401062.339388:0:14902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786401062.339392:0:14902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1edc3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c004 expref: 11 pid: 14902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.339401:0:14902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5ab800, rc 0) 00000100:00100000:0.0:1786401062.339457:0:14902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9366b5e6-e19b-4a08-b543-2a32b0307b57+10:14405:x1873176850189568:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 949us (1225us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1786401062.339466:0:14902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 25 00000100:00100000:3.0:1786401062.348619:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401062.348726:0:14241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850189696 00000100:00100000:0.0:1786401062.348755:0:14241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850189696 00000100:00100000:0.0:1786401062.348849:0:14241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 26 00000100:00100000:0.0:1786401062.348860:0:14241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd890380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9366b5e6-e19b-4a08-b543-2a32b0307b57+10:14405:x1873176850189696:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:0.0:1786401062.348887:0:14241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786401062.348911:0:14241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5abe00/0x5ccaaf4f3cb1eddf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6c00b expref: -99 pid: 14241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.348998:0:14241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1ede6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.349012:0:14241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1ede6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.349023:0:14241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1ede6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786401062.349077:0:14241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1786401062.349080:0:14241:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1786401062.349133:0:14241:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1ede6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.349162:0:14241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5abe00/0x5ccaaf4f3cb1eddf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c00b expref: 12 pid: 14241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.349183:0:14241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1ede6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c00b expref: 11 pid: 14241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.349192:0:14241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:0.0:1786401062.349195:0:14241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1786401062.349199:0:14241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5aac00, rc 0) 00000100:00100000:0.0:1786401062.349281:0:14241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd890380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9366b5e6-e19b-4a08-b543-2a32b0307b57+11:14405:x1873176850189696:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 422us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401062.349288:0:14241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 26 00000100:00100000:1.0:1786401062.364007:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401062.364117:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850189824 00000100:00100000:0.0:1786401062.364127:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850189824 00000100:00100000:0.0:1786401062.364222:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 3 00000100:00100000:0.0:1786401062.364233:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9366b5e6-e19b-4a08-b543-2a32b0307b57+11:14405:x1873176850189824:12345-192.168.204.8@tcp:37:lfs.0 00000100:00100000:0.0:1786401062.372543:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9366b5e6-e19b-4a08-b543-2a32b0307b57+11:14405:x1873176850189824:12345-192.168.204.8@tcp:37:lfs.0 Request processed in 8301us (8536us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401062.372557:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 3 00000100:00100000:3.0:1786401062.384852:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786401062.385525:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850190080 00000100:00100000:1.0:1786401062.385536:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850190080 00000100:00100000:1.0:1786401062.385614:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4 00000100:00100000:1.0:1786401062.385624:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1d4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9366b5e6-e19b-4a08-b543-2a32b0307b57+11:14405:x1873176850190080:12345-192.168.204.8@tcp:35:lfs.0 00000100:00100000:1.0:1786401062.385920:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1d4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9366b5e6-e19b-4a08-b543-2a32b0307b57+12:14405:x1873176850190080:12345-192.168.204.8@tcp:35:lfs.0 Request processed in 297us (1081us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1786401062.385928:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4 00000100:00100000:1.0:1786401062.502035:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401062.502182:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850190208 00000100:00100000:3.0:1786401062.502193:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850190208 00000100:00100000:3.0:1786401062.502305:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 27 00000100:00100000:3.0:1786401062.502317:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+10:14411:x1873176850190208:12345-192.168.204.8@tcp:101:bash.0 00010000:00010000:3.0:1786401062.502339:0:14242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786401062.502361:0:14242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1eded lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6c012 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.502437:0:14242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4400/0x5ccaaf4f3cb1edf4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.502465:0:14242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4400/0x5ccaaf4f3cb1edf4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.502477:0:14242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4400/0x5ccaaf4f3cb1edf4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.502493:0:14242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5600/0x5ccaaf4f3cb1edfb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.502500:0:14242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5600/0x5ccaaf4f3cb1edfb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.502506:0:14242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5600/0x5ccaaf4f3cb1edfb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.503396:0:14242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5200/0x5ccaaf4f3cb1ee02 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.503409:0:14242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5200/0x5ccaaf4f3cb1ee02 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.503418:0:14242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5200/0x5ccaaf4f3cb1ee02 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786401062.503449:0:14242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1786401062.503453:0:14242:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786401062.503488:0:14242:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5200/0x5ccaaf4f3cb1ee02 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.503501:0:14242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4400/0x5ccaaf4f3cb1edf4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.503521:0:14242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4400/0x5ccaaf4f3cb1edf4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.503528:0:14242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4400/0x5ccaaf4f3cb1edf4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.503533:0:14242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d70020e4400 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786401062.503538:0:14242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4400/0x5ccaaf4f3cb1edf4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.503545:0:14242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4400/0x5ccaaf4f3cb1edf4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.503558:0:14242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fc2ed7700) 00010000:00010000:3.0:1786401062.503561:0:14242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786401062.503566:0:14242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4400/0x5ccaaf4f3cb1edf4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.503571:0:14242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4400/0x5ccaaf4f3cb1edf4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.503666:0:14242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5600/0x5ccaaf4f3cb1edfb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.503682:0:14242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5600/0x5ccaaf4f3cb1edfb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.503689:0:14242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5600/0x5ccaaf4f3cb1edfb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.503695:0:14242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d70020e5600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786401062.503704:0:14242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5600/0x5ccaaf4f3cb1edfb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.503711:0:14242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5600/0x5ccaaf4f3cb1edfb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.503719:0:14242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d6fc5599400) 00010000:00010000:3.0:1786401062.503722:0:14242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786401062.503724:0:14242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5600/0x5ccaaf4f3cb1edfb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.503730:0:14242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5600/0x5ccaaf4f3cb1edfb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.503767:0:14242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1eded lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c012 expref: 12 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.503779:0:14242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5200/0x5ccaaf4f3cb1ee02 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c012 expref: 11 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.503787:0:14242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:3.0:1786401062.503789:0:14242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1786401062.503792:0:14242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d70020e5200, rc 0) 00000100:00100000:3.0:1786401062.503861:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+11:14411:x1873176850190208:12345-192.168.204.8@tcp:101:bash.0 Request processed in 1547us (1837us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401062.503870:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 27 00000100:00100000:3.0:1786401062.512048:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786401062.512221:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850190464 00000100:00100000:2.0:1786401062.512231:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850190464 00000100:00100000:2.0:1786401062.512350:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 28 00000100:00100000:2.0:1786401062.512361:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+11:14411:x1873176850190464:12345-192.168.204.8@tcp:101:bash.0 00010000:00010000:2.0:1786401062.512384:0:14243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786401062.512416:0:14243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1ee09 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6c019 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401062.512548:0:14243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1ee10 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401062.512563:0:14243:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1ede6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c00b expref: 11 pid: 14241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401062.512572:0:14243:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1ee10 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401062.512619:0:14243:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1ede6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c00b expref: 11 pid: 14241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401062.512632:0:14243:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1ede6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c00b expref: 11 pid: 14241 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786401062.512645:0:14243:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdbc1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14243:1873176872195200:192.168.204.8@tcp:104: 00000100:00100000:2.0:1786401062.513742:0:14243:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc4e18900 going to sleep for 11 seconds 00000100:00100000:2.0:1786401062.521028:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786401062.521121:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850190592 00000100:00100000:1.0:1786401062.521130:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850190592 00010000:00010000:1.0:1786401062.521168:0:14226:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1ede6 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c00b expref: 12 pid: 14241 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786401062.521210:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 10 00000100:00100000:1.0:1786401062.521218:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9366b5e6-e19b-4a08-b543-2a32b0307b57+12:2364:x1873176850190592:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786401062.521232:0:14226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786401062.521239:0:14226:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1ede6 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c00b expref: 12 pid: 14241 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401062.521251:0:14226:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1ede6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c00b expref: 12 pid: 14241 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401062.521274:0:14226:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:1.0:1786401062.521279:0:14226:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1ee10 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401062.521289:0:14226:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1ee10 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401062.521308:0:14226:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1ee10 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401062.521327:0:14226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786401062.521377:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9366b5e6-e19b-4a08-b543-2a32b0307b57+12:2364:x1873176850190592:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 160us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401062.521384:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 10 00010000:00010000:0.0:1786401062.523042:0:14243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1ede6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c00b expref: 11 pid: 14241 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786401062.523067:0:14243:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdbc1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14243:1873176872195200:192.168.204.8@tcp:104: 00010000:00010000:0.0:1786401062.523170:0:14243:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1ee10 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.523181:0:14243:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1ee10 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.523186:0:14243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1ee10 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.523256:0:14243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5abe00/0x5ccaaf4f3cb1ee17 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.523268:0:14243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5abe00/0x5ccaaf4f3cb1ee17 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.523294:0:14243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5abe00/0x5ccaaf4f3cb1ee17 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.525289:0:14243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1ee1e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.525308:0:14243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1ee1e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.525319:0:14243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1ee1e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786401062.525331:0:14243:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1786401062.525362:0:14243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1ee10 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.525369:0:14243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1ee10 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.525376:0:14243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1ee10 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.525382:0:14243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5d400 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786401062.525387:0:14243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1ee10 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.525395:0:14243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1ee10 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.525408:0:14243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:0.0:1786401062.525411:0:14243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1786401062.525425:0:14243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1ee10 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.525431:0:14243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5d400/0x5ccaaf4f3cb1ee10 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1786401062.525447:0:14243:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fdc6ec5b reply state 00000000b86eba0e transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5abe00/0x5ccaaf4f3cb1ee17 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786401062.525456:0:14243:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1786401062.525494:0:14243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c000/0x5ccaaf4f3cb1ee09 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c019 expref: 14 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.525509:0:14243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1ee1e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c019 expref: 13 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.525516:0:14243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6fc90cd600) 00010000:00010000:0.0:1786401062.525519:0:14243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1786401062.525521:0:14243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5ab800, rc 0) 00000100:00100000:0.0:1786401062.525587:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+14:14411:x1873176850190464:12345-192.168.204.8@tcp:101:bash.0 Request processed in 13228us (13550us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1786401062.525596:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 28 00010000:00010000:1.0:1786401062.533285:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5abe00/0x5ccaaf4f3cb1ee17 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401062.533302:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5abe00/0x5ccaaf4f3cb1ee17 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401062.533310:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5abe00/0x5ccaaf4f3cb1ee17 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401062.533316:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5abe00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786401062.533321:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5abe00/0x5ccaaf4f3cb1ee17 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401062.533329:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5abe00/0x5ccaaf4f3cb1ee17 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401062.533345:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9d6fc90cdc00) 00010000:00010000:1.0:1786401062.533349:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1786401062.533353:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5abe00/0x5ccaaf4f3cb1ee17 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401062.533359:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5abe00/0x5ccaaf4f3cb1ee17 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786401062.550803:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401062.552800:0:14902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850190720 00000100:00100000:0.0:1786401062.552816:0:14902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850190720 00000100:00100000:1.0:1786401062.553012:0:14902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 29 00000100:00100000:1.0:1786401062.553023:0:14902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd892a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cedfe83e-8f3e-46c2-8429-f823952ad440+13:14411:x1873176850190720:12345-192.168.204.8@tcp:101:bash.0 00010000:00010000:1.0:1786401062.553049:0:14902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786401062.553072:0:14902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1ee2c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6c020 expref: -99 pid: 14902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401062.553166:0:14902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1ee33 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401062.553182:0:14902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1ee33 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401062.553194:0:14902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1ee33 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786401062.553237:0:14902:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1786401062.553241:0:14902:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1786401062.553262:0:14902:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1ee33 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401062.553273:0:14902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1ee33 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401062.553299:0:14902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1ee2c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c020 expref: 15 pid: 14902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401062.553319:0:14902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1ee33 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c020 expref: 14 pid: 14902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401062.553347:0:14902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6fc90cd600) 00010000:00010000:1.0:1786401062.553349:0:14902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786401062.553353:0:14902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138f400, rc 0) 00000100:00100000:1.0:1786401062.553429:0:14902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd892a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cedfe83e-8f3e-46c2-8429-f823952ad440+14:14411:x1873176850190720:12345-192.168.204.8@tcp:101:bash.0 Request processed in 407us (2636us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401062.553436:0:14902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 29 00000100:00100000:2.0:1786401062.563715:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786401062.563911:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850190976 00000100:00100000:1.0:1786401062.563921:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850190976 00000100:00100000:1.0:1786401062.564032:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 5 00000100:00100000:1.0:1786401062.564044:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+14:14411:x1873176850190976:12345-192.168.204.8@tcp:35:bash.0 00000100:00100000:1.0:1786401062.564438:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+15:14411:x1873176850190976:12345-192.168.204.8@tcp:35:bash.0 Request processed in 395us (731us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1786401062.564446:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 5 00010000:00010000:2.0:1786401062.575307:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1786401062.751635:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401062.751897:0:14241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850191232 00000100:00100000:0.0:1786401062.751908:0:14241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850191232 00000100:00100000:0.0:1786401062.752011:0:14241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 30 00000100:00100000:0.0:1786401062.752023:0:14241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cedfe83e-8f3e-46c2-8429-f823952ad440+15:14421:x1873176850191232:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:0.0:1786401062.752052:0:14241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786401062.752074:0:14241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1ee3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6c027 expref: -99 pid: 14241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1786401062.752258:0:14241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1786401062.752369:0:14241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1ee3a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c027 expref: 17 pid: 14241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.752383:0:14241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fc2ed7700) 00010000:00010000:0.0:1786401062.752386:0:14241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786401062.752406:0:14241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aac00/0x5ccaaf4f3cb1ee3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c027 expref: 17 pid: 14241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.752420:0:14241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5aac00, rc 0) 00000100:00100000:0.0:1786401062.752473:0:14241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cedfe83e-8f3e-46c2-8429-f823952ad440+16:14421:x1873176850191232:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 453us (850us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1786401062.752482:0:14241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 30 00000100:00100000:3.0:1786401062.760960:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401062.761667:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850191488 00000100:00100000:0.0:1786401062.761687:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850191488 00000100:00100000:0.0:1786401062.761750:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 6 00000100:00100000:0.0:1786401062.761761:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cedfe83e-8f3e-46c2-8429-f823952ad440+16:14421:x1873176850191488:12345-192.168.204.8@tcp:35:lfs.0 00000100:00100000:0.0:1786401062.762028:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cedfe83e-8f3e-46c2-8429-f823952ad440+17:14421:x1873176850191488:12345-192.168.204.8@tcp:35:lfs.0 Request processed in 267us (1077us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1786401062.762037:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 6 00000100:00100000:1.0:1786401062.829274:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401062.829411:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850191744 00000100:00100000:3.0:1786401062.829435:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850191744 00000100:00100000:3.0:1786401062.829549:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 31 00000100:00100000:3.0:1786401062.829560:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+17:14424:x1873176850191744:12345-192.168.204.8@tcp:101:lfs.0 00010000:00010000:3.0:1786401062.829587:0:14242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786401062.829608:0:14242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1ee48 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6c02e expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.829818:0:14242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5600/0x5ccaaf4f3cb1ee4f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.829832:0:14242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5600/0x5ccaaf4f3cb1ee4f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.829846:0:14242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5600/0x5ccaaf4f3cb1ee4f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786401062.829857:0:14242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1786401062.829982:0:14242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1ee48 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c02e expref: 20 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.830003:0:14242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5600/0x5ccaaf4f3cb1ee4f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c02e expref: 19 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401062.830012:0:14242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6fc90cd600) 00010000:00010000:3.0:1786401062.830015:0:14242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1786401062.830019:0:14242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d70020e5600, rc 0) 00000100:00100000:3.0:1786401062.830159:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+19:14424:x1873176850191744:12345-192.168.204.8@tcp:101:lfs.0 Request processed in 600us (894us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1786401062.830168:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 31 00000100:00100000:2.0:1786401062.836331:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401062.836450:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850191872 00000100:00100000:0.0:1786401062.836460:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850191872 00000100:00100000:0.0:1786401062.836927:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 32 00000100:00100000:0.0:1786401062.836939:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+19:14424:x1873176850191872:12345-192.168.204.8@tcp:54:lfs.0 00010000:00010000:0.0:1786401062.837013:0:14243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1ee5d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.837040:0:14243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1ee5d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.837052:0:14243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1ee5d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.837078:0:14243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1ee5d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.837116:0:14243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1ee5d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.837124:0:14243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1ee5d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.837130:0:14243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aae00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:0.0:1786401062.837134:0:14243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1ee5d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.837140:0:14243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1ee5d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.837152:0:14243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6fc90cd600) 00010000:00010000:0.0:1786401062.837155:0:14243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1786401062.837159:0:14243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1ee5d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401062.837165:0:14243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1ee5d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786401062.837240:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+19:14424:x1873176850191872:12345-192.168.204.8@tcp:54:lfs.0 Request processed in 304us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401062.837254:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 32 00000100:00100000:3.0:1786401062.839605:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786401062.839869:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850192000 00000100:00100000:1.0:1786401062.839879:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850192000 00000100:00100000:1.0:1786401062.839952:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 0 00000100:00100000:1.0:1786401062.839962:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+19:2364:x1873176850192000:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786401062.839977:0:14228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786401062.840001:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5600/0x5ccaaf4f3cb1ee4f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c02e expref: 19 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401062.840020:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6fc90cd600) 00010000:00010000:1.0:1786401062.840025:0:14228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786401062.840117:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+18:2364:x1873176850192000:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 126us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401062.840125:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 0 00000100:00100000:1.0:1786401062.843804:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401062.844014:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850192256 00000100:00100000:0.0:1786401062.844025:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850192256 00000100:00100000:0.0:1786401062.844108:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 7 00000100:00100000:0.0:1786401062.844120:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cedfe83e-8f3e-46c2-8429-f823952ad440+18:14424:x1873176850192256:12345-192.168.204.8@tcp:35:lfs.0 00000100:00100000:0.0:1786401062.845240:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cedfe83e-8f3e-46c2-8429-f823952ad440+19:14424:x1873176850192256:12345-192.168.204.8@tcp:35:lfs.0 Request processed in 1113us (1438us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1786401062.845250:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 7 00000001:00080000:3.0:1786401063.205463:0:5810:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934605 is committed 00000001:00080000:3.0:1786401063.205488:0:5810:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:3.0:1786401063.205498:0:5810:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1786401063.218620:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786401063.218958:0:14902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850192512 00000100:00100000:1.0:1786401063.218968:0:14902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850192512 00000100:00100000:1.0:1786401063.219221:0:14902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 33 00000100:00100000:1.0:1786401063.219233:0:14902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cedfe83e-8f3e-46c2-8429-f823952ad440+11:14456:x1873176850192512:12345-192.168.204.8@tcp:101:cat.0 00010000:00010000:1.0:1786401063.219258:0:14902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786401063.219281:0:14902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1ee64 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6c035 expref: -99 pid: 14902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401063.219374:0:14902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1ee6b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401063.219388:0:14902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1ee6b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401063.219400:0:14902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1ee6b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1786401063.219410:0:14902:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1786401063.219589:0:14902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1ee64 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c035 expref: 14 pid: 14902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401063.219609:0:14902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1ee6b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c035 expref: 13 pid: 14902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401063.219618:0:14902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6fc90cd600) 00010000:00010000:1.0:1786401063.219633:0:14902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1786401063.219637:0:14902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138ea00, rc 0) 00000100:00100000:1.0:1786401063.219707:0:14902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cedfe83e-8f3e-46c2-8429-f823952ad440+13:14456:x1873176850192512:12345-192.168.204.8@tcp:101:cat.0 Request processed in 476us (1156us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1786401063.219714:0:14902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 33 00000100:00100000:3.0:1786401063.227310:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401063.227648:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850192768 00000100:00100000:0.0:1786401063.227670:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850192768 00000100:00100000:0.0:1786401063.227782:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 8 00000100:00100000:0.0:1786401063.227793:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cedfe83e-8f3e-46c2-8429-f823952ad440+13:14456:x1873176850192768:12345-192.168.204.8@tcp:35:cat.0 00000100:00100000:0.0:1786401063.228439:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cedfe83e-8f3e-46c2-8429-f823952ad440+14:14456:x1873176850192768:12345-192.168.204.8@tcp:35:cat.0 Request processed in 645us (1151us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1786401063.228448:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 8 00000100:00100000:3.0:1786401063.228965:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401063.229138:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850192896 00000100:00100000:0.0:1786401063.229145:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850192896 00000100:00100000:0.0:1786401063.229251:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1 00000100:00100000:0.0:1786401063.229260:0:14227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+14:2365:x1873176850192896:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786401063.229273:0:14227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786401063.229306:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138ea00/0x5ccaaf4f3cb1ee6b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c035 expref: 14 pid: 14902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401063.229325:0:14227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6fc90cd600) 00010000:00010000:0.0:1786401063.229329:0:14227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1786401063.229366:0:14227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+13:2365:x1873176850192896:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 108us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401063.229373:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1 00000100:00100000:3.0:1786401063.298238:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401063.298371:0:14241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850193152 00000100:00100000:0.0:1786401063.298382:0:14241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850193152 00000100:00100000:0.0:1786401063.298453:0:14241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 34 00000100:00100000:0.0:1786401063.298462:0:14241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cedfe83e-8f3e-46c2-8429-f823952ad440+13:14462:x1873176850193152:12345-192.168.204.8@tcp:101:dd.0 00010000:00010000:0.0:1786401063.298487:0:14241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786401063.298507:0:14241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1ee79 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6c03c expref: -99 pid: 14241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401063.298934:0:14241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1ee80 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401063.298950:0:14241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1ee1e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c019 expref: 14 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401063.298959:0:14241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1ee33 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c020 expref: 14 pid: 14902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401063.298966:0:14241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1ee80 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401063.299000:0:14241:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1ee33 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c020 expref: 14 pid: 14902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401063.299015:0:14241:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1ee33 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c020 expref: 14 pid: 14902 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786401063.299451:0:14241:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc99c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14241:1873176872195328:192.168.204.8@tcp:104: 00010000:00010000:1.0:1786401063.299820:0:14241:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1ee1e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c019 expref: 14 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401063.299831:0:14241:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1ee1e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c019 expref: 14 pid: 14243 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786401063.299842:0:14241:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14241:1873176872195456:192.168.204.8@tcp:104: 00000100:00100000:1.0:1786401063.299917:0:14241:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fcae24780 going to sleep for 11 seconds 00000100:00100000:2.0:1786401063.307399:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786401063.307444:0:14241:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc99c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14241:1873176872195328:192.168.204.8@tcp:104: 00000100:00100000:2.0:1786401063.307451:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786401063.307465:0:14241:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14241:1873176872195456:192.168.204.8@tcp:104: 00010000:00010000:1.0:1786401063.307495:0:14241:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1ee80 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786401063.307607:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850193280 00000100:00100000:0.0:1786401063.307614:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850193280 00010000:00010000:0.0:1786401063.307649:0:14228:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1ee33 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c020 expref: 15 pid: 14902 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786401063.307698:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850193408 00000100:00100000:0.0:1786401063.307701:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850193408 00010000:00010000:0.0:1786401063.307713:0:14228:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1ee1e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c019 expref: 16 pid: 14243 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786401063.307727:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 11 00000100:00100000:0.0:1786401063.307734:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc88850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+16:2365:x1873176850193280:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786401063.307747:0:14228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786401063.307753:0:14228:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1ee33 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c020 expref: 16 pid: 14902 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401063.307763:0:14228:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1ee33 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c020 expref: 16 pid: 14902 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401063.307784:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1ee33 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c020 expref: 16 pid: 14902 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401063.307801:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6fc90cd600) 00010000:00010000:0.0:1786401063.307806:0:14228:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1ee80 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401063.307828:0:14228:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1ee80 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401063.307835:0:14228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786401063.307836:0:14226:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1786401063.307847:0:14226:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1786401063.307885:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc88850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+15:2365:x1873176850193280:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 149us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401063.307894:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 11 00000100:00100000:2.0:1786401063.308065:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 12 00000100:00100000:2.0:1786401063.308075:0:14227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+14:2363:x1873176850193408:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1786401063.308125:0:14227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786401063.308132:0:14227:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1ee1e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c019 expref: 14 pid: 14243 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401063.308142:0:14227:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1ee1e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c019 expref: 14 pid: 14243 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401063.308155:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab800/0x5ccaaf4f3cb1ee1e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c019 expref: 14 pid: 14243 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401063.308167:0:14227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6fc90cd600) 00010000:00010000:2.0:1786401063.308170:0:14227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1ee80 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401063.308179:0:14227:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1ee80 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401063.308186:0:14227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1ee80 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401063.308209:0:14227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1786401063.308239:0:14241:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1ee80 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786401063.308241:0:14227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+13:2363:x1873176850193408:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 168us (793us total) trans 0 rc 0/0 00010000:00010000:1.0:1786401063.308257:0:14241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1ee80 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786401063.308273:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 12 00000004:00200000:1.0:1786401063.308286:0:14241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1786401063.308692:0:14241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1ee79 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c03c expref: 14 pid: 14241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401063.308725:0:14241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aaa00/0x5ccaaf4f3cb1ee80 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c03c expref: 13 pid: 14241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401063.308733:0:14241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6fc90cd600) 00010000:00010000:1.0:1786401063.308736:0:14241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1786401063.308739:0:14241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5aaa00, rc 0) 00000100:00100000:1.0:1786401063.308914:0:14241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cedfe83e-8f3e-46c2-8429-f823952ad440+13:14462:x1873176850193152:12345-192.168.204.8@tcp:101:dd.0 Request processed in 10383us (10616us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1786401063.308922:0:14241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 34 00000100:00100000:3.0:1786401063.317322:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401063.317866:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850193664 00000100:00100000:0.0:1786401063.317877:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850193664 00000100:00100000:0.0:1786401063.317947:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 35 00000100:00100000:0.0:1786401063.317958:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+13:14462:x1873176850193664:12345-192.168.204.8@tcp:36:dd.0 00010000:00010000:0.0:1786401063.318277:0:14242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1ee8e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401063.318296:0:14242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1ee8e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401063.318307:0:14242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1ee8e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1786401063.318356:0:14242:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1786401063.319671:0:14242:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ec1f2d96 reply state 000000005e0b3c09 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1ee8e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786401063.319688:0:14242:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1786401063.319829:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+16:14462:x1873176850193664:12345-192.168.204.8@tcp:36:dd.0 Request processed in 1870us (2514us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1786401063.319839:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 35 00000020:00080000:0.0:1786401063.319845:0:14242:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1786401063.323836:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1ee8e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401063.323858:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1ee8e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401063.323865:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1ee8e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401063.323871:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aba00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786401063.323876:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1ee8e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401063.323884:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1ee8e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401063.323901:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6fc90cd600) 00010000:00010000:2.0:1786401063.323904:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786401063.323908:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1ee8e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401063.323914:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1ee8e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786401063.329049:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786401063.329545:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850193792 00000100:00100000:2.0:1786401063.329786:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850193792 00000100:00100000:2.0:1786401063.329972:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 36 00000100:00100000:2.0:1786401063.329987:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+15:14462:x1873176850193792:12345-192.168.204.8@tcp:101:dd.0 00010000:00010000:2.0:1786401063.330014:0:14243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786401063.330055:0:14243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c200/0x5ccaaf4f3cb1ee95 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6c043 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401063.330142:0:14243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c200/0x5ccaaf4f3cb1ee95 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c043 expref: 16 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401063.330158:0:14243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c200/0x5ccaaf4f3cb1ee95 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c043 expref: 16 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401063.330178:0:14243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6fc90cd600) 00010000:00010000:2.0:1786401063.330182:0:14243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786401063.330186:0:14243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc4e5c200, rc 0) 00000100:00100000:2.0:1786401063.330262:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+16:14462:x1873176850193792:12345-192.168.204.8@tcp:101:dd.0 Request processed in 280us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401063.330269:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 36 00000100:00100000:3.0:1786401063.370947:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786401063.371066:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850194048 00000100:00100000:2.0:1786401063.371077:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850194048 00000100:00100000:2.0:1786401063.371181:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2 00000100:00100000:2.0:1786401063.371191:0:14227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+16:14462:x1873176850194048:12345-192.168.204.8@tcp:103:dd.0 00010000:00010000:2.0:1786401063.371209:0:14227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786401063.371235:0:14227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c200/0x5ccaaf4f3cb1ee95 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c043 expref: 16 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401063.371344:0:14227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6fc90cd600) 00010000:00010000:2.0:1786401063.371350:0:14227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1786401063.371408:0:14227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+15:14462:x1873176850194048:12345-192.168.204.8@tcp:103:dd.0 Request processed in 217us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401063.371416:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2 00000100:00100000:3.0:1786401063.374243:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786401063.374421:0:14902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850194176 00000100:00100000:1.0:1786401063.374432:0:14902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850194176 00000100:00100000:1.0:1786401063.374554:0:14902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 37 00000100:00100000:1.0:1786401063.374585:0:14902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cedfe83e-8f3e-46c2-8429-f823952ad440+15:14462:x1873176850194176:12345-192.168.204.8@tcp:58:dd.0 00010000:00010000:1.0:1786401063.374707:0:14902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1ee9c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401063.374724:0:14902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1ee9c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401063.374737:0:14902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1ee9c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1786401063.375583:0:14902:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1786401063.375747:0:14902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1786401063.375820:0:14902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1786401063.375930:0:14902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cedfe83e-8f3e-46c2-8429-f823952ad440+15:14462:x1873176850194176:12345-192.168.204.8@tcp:58:dd.0 Request processed in 1353us (1692us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401063.375949:0:14902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 37 00000100:00100000:3.0:1786401063.383715:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786401063.384123:0:14241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850194304 00000100:00100000:1.0:1786401063.384133:0:14241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850194304 00000100:00100000:1.0:1786401063.384239:0:14241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 38 00000100:00100000:1.0:1786401063.384250:0:14241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cedfe83e-8f3e-46c2-8429-f823952ad440+15:14462:x1873176850194304:12345-192.168.204.8@tcp:101:dd.0 00010000:00010000:1.0:1786401063.384272:0:14241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786401063.384294:0:14241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1eea3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6c04a expref: -99 pid: 14241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401063.384359:0:14241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1ee9c lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401063.384371:0:14241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1eea3 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c04a expref: 16 pid: 14241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401063.384402:0:14241:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1ee9c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401063.384416:0:14241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1eea3 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c04a expref: 16 pid: 14241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401063.384430:0:14241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6fc90cd600) 00010000:00010000:1.0:1786401063.384433:0:14241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1786401063.384438:0:14241:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1eea3 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c04a expref: 16 pid: 14241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401063.384446:0:14241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138f400, rc 0) 00000100:00100000:1.0:1786401063.384508:0:14241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cedfe83e-8f3e-46c2-8429-f823952ad440+16:14462:x1873176850194304:12345-192.168.204.8@tcp:101:dd.0 Request processed in 260us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401063.384539:0:14241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 38 00010000:00010000:2.0:1786401063.598281:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1786401064.174417:0:14275:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1786401064.174430:0:14275:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1786401064.174476:0:14275:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1786401064.174482:0:14275:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1786401064.174639:0:14275:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdc9a300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14275:1873176872195584:192.168.204.8@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1786401064.174775:0:14275:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fcae24b40 going to sleep for 11 seconds 00000100:00100000:2.0:1786401064.174958:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdbc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872195968:0@lo:400:kworker.0 00000100:00100000:3.0:1786401064.175002:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdbc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872195840:0@lo:400:kworker.0 00000100:00100000:2.0:1786401064.175026:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786401064.175051:0:14878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872195968 00000100:00100000:3.0:1786401064.175059:0:14878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872195968 00000100:00100000:3.0:1786401064.175132:0:14878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1786401064.175142:0:14878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872195968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786401064.175191:0:14878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872195968:12345-0@lo:400:kworker.0 Request processed in 51us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401064.175198:0:14878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1786401064.175219:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786401064.175237:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdbc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873176872196352:0@lo:400:kworker.0 00000100:00100000:3.0:1786401064.175264:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786401064.175283:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1786401064.175290:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdbc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:054a13af-ec40-49d6-93c2-21045d196afe:3309:1873176872195712:0@lo:400:kworker.0 00000100:00100000:2.0:1786401064.175298:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1786401064.175311:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdbc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872196096:0@lo:400:kworker.0 00000100:00100000:3.0:1786401064.175319:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786401064.175346:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786401064.175364:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ffdbc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873176872196224:0@lo:400:kworker.0 00000100:00100000:2.0:1786401064.175389:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdbc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872195968:0@lo:400:kworker.0 00000100:00100000:3.0:1786401064.175395:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786401064.175428:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872196352 00000100:00100000:3.0:1786401064.175433:0:14877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872195840 00000100:00100000:2.0:1786401064.175433:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872196352 00000100:00100000:3.0:1786401064.175439:0:14877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872195840 00000100:00100000:2.0:1786401064.175469:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872196096 00000100:00100000:2.0:1786401064.175473:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872196096 00000100:00100000:3.0:1786401064.175479:0:14877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1786401064.175489:0:14877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872195840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786401064.175493:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872196224 00000100:00100000:2.0:1786401064.175497:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872196224 00000100:00100000:2.0:1786401064.175522:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1786401064.175530:0:14877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872195840:12345-0@lo:400:kworker.0 Request processed in 44us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401064.175532:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873176872196352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786401064.175541:0:14877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1786401064.175569:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdbc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872195840:0@lo:400:kworker.0 00000100:00100000:3.0:1786401064.175594:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdbc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1873176872196352:0@lo:400:kworker.0 00000100:00100000:2.0:1786401064.175596:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1873176872196352:12345-0@lo:400:kworker.0 Request processed in 64us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401064.175605:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1786401064.175614:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1786401064.175623:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6fe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872196096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786401064.175628:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1786401064.175638:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873176872196224:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1786401064.175894:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1786401064.175899:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786401064.175901:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786401064.175906:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1786401064.175916:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872196480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786401064.175982:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872195712 00000100:00100000:0.0:1786401064.175986:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872195712 00000100:00100000:0.0:1786401064.176186:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1786401064.176194:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+19:3309:x1873176872195712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786401064.176271:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1873176872196224:12345-0@lo:400:kworker.0 Request processed in 635us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401064.176279:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1786401064.176314:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6fe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1873176872196096:12345-0@lo:400:kworker.0 Request processed in 692us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401064.176322:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1786401064.176356:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdbc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1873176872196224:0@lo:400:kworker.0 00000100:00100000:3.0:1786401064.176765:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdbc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1873176872196096:0@lo:400:kworker.0 00000100:00100000:1.0:1786401064.186655:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401064.187446:0:14275:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdc9a300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14275:1873176872195584:192.168.204.8@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1786401064.188946:0:14882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872196480 00000100:00100000:3.0:1786401064.188961:0:14882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872196480 00000100:00100000:3.0:1786401064.189249:0:14882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1786401064.189260:0:14882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872196480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1786401064.189310:0:14882:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1786401064.189419:0:14882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872196480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 161us (2780us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401064.189443:0:14882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1786401064.190484:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872196480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786401064.191405:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+19:3309:x1873176872195712:12345-0@lo:400:kworker.0 Request processed in 15208us (16081us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401064.191416:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1786401064.192579:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ffdbc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:054a13af-ec40-49d6-93c2-21045d196afe:3309:1873176872195712:0@lo:400:kworker.0 00000100:00100000:3.0:1786401064.197008:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786401064.198681:0:14252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850194432 00000100:00100000:2.0:1786401064.198696:0:14252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850194432 00000100:00100000:2.0:1786401064.198881:0:14252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 0 00000100:00100000:2.0:1786401064.198914:0:14252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:cedfe83e-8f3e-46c2-8429-f823952ad440+16:14464:x1873176850194432:12345-192.168.204.8@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1786401064.199261:0:14252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:cedfe83e-8f3e-46c2-8429-f823952ad440+16:14464:x1873176850194432:12345-192.168.204.8@tcp:900:lhsmtool_posix.0 Request processed in 348us (2272us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401064.199270:0:14252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 0 00000100:00080000:1.0:1786401064.201813:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1786401064.205845:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401064.205985:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850194560 00000100:00100000:0.0:1786401064.206247:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850194560 00000100:00100000:0.0:1786401064.206393:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 39 00000100:00100000:0.0:1786401064.206404:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+16:14464:x1873176850194560:12345-192.168.204.8@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1786401064.206440:0:14243:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1786401064.206745:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+16:14464:x1873176850194560:12345-192.168.204.8@tcp:53:lhsmtool_posix.0 Request processed in 341us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401064.206753:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 39 00000100:00100000:2.0:1786401064.213525:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401064.214023:0:14241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850194688 00000100:00100000:3.0:1786401064.214035:0:14241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850194688 00000100:00100000:3.0:1786401064.214284:0:14241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 40 00000100:00100000:3.0:1786401064.214296:0:14241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cedfe83e-8f3e-46c2-8429-f823952ad440+16:14464:x1873176850194688:12345-192.168.204.8@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1786401064.214398:0:14241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5600/0x5ccaaf4f3cb1eeaa lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.214415:0:14241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5600/0x5ccaaf4f3cb1eeaa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.214427:0:14241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5600/0x5ccaaf4f3cb1eeaa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.214498:0:14241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4400/0x5ccaaf4f3cb1eeb1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.214507:0:14241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4400/0x5ccaaf4f3cb1eeb1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.214514:0:14241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4400/0x5ccaaf4f3cb1eeb1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.214844:0:14241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1eeb8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.214855:0:14241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1eeb8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.214870:0:14241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1eeb8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786401064.214988:0:14241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1786401064.214993:0:14241:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786401064.215009:0:14241:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1eeb8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.215022:0:14241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5600/0x5ccaaf4f3cb1eeaa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.215028:0:14241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5600/0x5ccaaf4f3cb1eeaa lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.215035:0:14241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5600/0x5ccaaf4f3cb1eeaa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.215041:0:14241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d70020e5600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786401064.215046:0:14241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5600/0x5ccaaf4f3cb1eeaa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.215054:0:14241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5600/0x5ccaaf4f3cb1eeaa lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.215066:0:14241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d6fc2ed7300) 00010000:00010000:3.0:1786401064.215421:0:14241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786401064.215428:0:14241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5600/0x5ccaaf4f3cb1eeaa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.215434:0:14241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5600/0x5ccaaf4f3cb1eeaa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.215460:0:14241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4400/0x5ccaaf4f3cb1eeb1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.215467:0:14241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4400/0x5ccaaf4f3cb1eeb1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.215472:0:14241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4400/0x5ccaaf4f3cb1eeb1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.215477:0:14241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d70020e4400 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786401064.215480:0:14241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4400/0x5ccaaf4f3cb1eeb1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.215486:0:14241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4400/0x5ccaaf4f3cb1eeb1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.215495:0:14241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9d6fc5599800) 00010000:00010000:3.0:1786401064.215498:0:14241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786401064.215501:0:14241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4400/0x5ccaaf4f3cb1eeb1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.215507:0:14241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4400/0x5ccaaf4f3cb1eeb1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.215711:0:14241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1eeb8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.215717:0:14241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1eeb8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.215724:0:14241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1eeb8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.215735:0:14241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d70020e4200 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786401064.215738:0:14241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1eeb8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.215744:0:14241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1eeb8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.215753:0:14241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6fc90cd600) 00010000:00010000:3.0:1786401064.215756:0:14241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1786401064.215758:0:14241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1eeb8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.215764:0:14241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1eeb8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786401064.216021:0:14241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cedfe83e-8f3e-46c2-8429-f823952ad440+16:14464:x1873176850194688:12345-192.168.204.8@tcp:34:lhsmtool_posix.0 Request processed in 1723us (2503us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401064.216031:0:14241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 40 00000100:00100000:2.0:1786401064.224082:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401064.224296:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850194944 00000100:00100000:3.0:1786401064.224306:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850194944 00000100:00100000:3.0:1786401064.224411:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 41 00000100:00100000:3.0:1786401064.224422:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+16:14464:x1873176850194944:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786401064.224443:0:14242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786401064.224463:0:14242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1eebf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6c051 expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.224924:0:14242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4400/0x5ccaaf4f3cb1eec6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.224958:0:14242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4400/0x5ccaaf4f3cb1eec6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.224969:0:14242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4400/0x5ccaaf4f3cb1eec6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786401064.224981:0:14242:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1786401064.225083:0:14242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4400/0x5ccaaf4f3cb1eec6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.225115:0:14242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4400/0x5ccaaf4f3cb1eec6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.225122:0:14242:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4400/0x5ccaaf4f3cb1eec6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.225129:0:14242:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d70020e4400 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:3.0:1786401064.225133:0:14242:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4400/0x5ccaaf4f3cb1eec6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.225141:0:14242:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4400/0x5ccaaf4f3cb1eec6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.225155:0:14242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6fc90cd600) 00010000:00010000:3.0:1786401064.225158:0:14242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1786401064.225163:0:14242:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4400/0x5ccaaf4f3cb1eec6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.225169:0:14242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4400/0x5ccaaf4f3cb1eec6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.225211:0:14242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1eebf lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c051 expref: 18 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.225227:0:14242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d6fc2ed7300) 00010000:00010000:3.0:1786401064.225229:0:14242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1786401064.225233:0:14242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1eebf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c051 expref: 18 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.225242:0:14242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d70020e4200, rc 0) 00000100:00100000:3.0:1786401064.225312:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+17:14464:x1873176850194944:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 891us (1241us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1786401064.225319:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 41 00000100:00100000:2.0:1786401064.230757:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786401064.232182:0:14902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850195072 00000100:00100000:1.0:1786401064.232196:0:14902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850195072 00000100:00100000:1.0:1786401064.232294:0:14902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 42 00000100:00100000:1.0:1786401064.232304:0:14902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cedfe83e-8f3e-46c2-8429-f823952ad440+17:14464:x1873176850195072:12345-192.168.204.8@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1786401064.232345:0:14902:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1786401064.232520:0:14902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cedfe83e-8f3e-46c2-8429-f823952ad440+17:14464:x1873176850195072:12345-192.168.204.8@tcp:53:lhsmtool_posix.0 Request processed in 217us (1773us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401064.232529:0:14902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 42 00000100:00100000:2.0:1786401064.239775:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401064.240284:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850195328 00000100:00100000:0.0:1786401064.240296:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850195328 00000100:00100000:0.0:1786401064.240365:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 43 00000100:00100000:0.0:1786401064.240378:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+17:14464:x1873176850195328:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1786401064.240408:0:14243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1786401064.240435:0:14243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1eed4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6c058 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1786401064.242379:0:14243:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:0.0:1786401064.242390:0:14243:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1786401064.242441:0:14243:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:0.0:1786401064.243353:0:14243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1eedb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401064.243374:0:14243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1eedb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401064.243387:0:14243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1eedb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401064.243462:0:14243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aba00/0x5ccaaf4f3cb1eed4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c058 expref: 20 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401064.243481:0:14243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1eedb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c058 expref: 19 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401064.243490:0:14243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d6fc90cd800) 00010000:00010000:0.0:1786401064.243493:0:14243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1786401064.243497:0:14243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffd5ab600, rc 0) 00000100:00100000:0.0:1786401064.245316:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+19:14464:x1873176850195328:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 4930us (5541us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1786401064.245328:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 43 00000100:00100000:2.0:1786401064.253229:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401064.254014:0:14241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850195584 00000100:00100000:3.0:1786401064.254028:0:14241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850195584 00000100:00100000:2.0:1786401064.254597:0:14241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 44 00000100:00100000:2.0:1786401064.254610:0:14241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cedfe83e-8f3e-46c2-8429-f823952ad440+19:14464:x1873176850195584:12345-192.168.204.8@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786401064.254691:0:14241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786401064.254720:0:14241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5ab600/0x5ccaaf4f3cb1eedb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c058 expref: 19 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.254741:0:14241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d6fc90cd800) 00010000:00010000:2.0:1786401064.254752:0:14241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786401064.254776:0:14241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1eee9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.254790:0:14241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1eee9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.254801:0:14241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1eee9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.254814:0:14241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c600/0x5ccaaf4f3cb1eef0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x89e10204 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.254836:0:14241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c600/0x5ccaaf4f3cb1eef0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x89e10204 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.254842:0:14241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c600/0x5ccaaf4f3cb1eef0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x89e10204 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.255204:0:14241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1eee9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.255213:0:14241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1eee9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.255218:0:14241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1eee9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.255224:0:14241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5da00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786401064.255228:0:14241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1eee9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.255235:0:14241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1eee9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.255243:0:14241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d6fc90cd300) 00010000:00010000:2.0:1786401064.255247:0:14241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786401064.255250:0:14241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1eee9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.255255:0:14241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5da00/0x5ccaaf4f3cb1eee9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.255264:0:14241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c600/0x5ccaaf4f3cb1eef0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x89e10204 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.255276:0:14241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c600/0x5ccaaf4f3cb1eef0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x89e10204 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.255281:0:14241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c600/0x5ccaaf4f3cb1eef0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x89e10204 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.255286:0:14241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5c600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786401064.255289:0:14241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c600/0x5ccaaf4f3cb1eef0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x89e10204 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.255294:0:14241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c600/0x5ccaaf4f3cb1eef0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x89e10204 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.255301:0:14241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x89e10204 (ffff9d6fc2ed7d00) 00010000:00010000:2.0:1786401064.255303:0:14241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786401064.255305:0:14241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c600/0x5ccaaf4f3cb1eef0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x89e10204 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.255310:0:14241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c600/0x5ccaaf4f3cb1eef0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x89e10204 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786401064.255411:0:14241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cedfe83e-8f3e-46c2-8429-f823952ad440+18:14464:x1873176850195584:12345-192.168.204.8@tcp:36:lhsmtool_posix.0 Request processed in 802us (2191us total) trans 0 rc -2/-2 00000100:00100000:2.0:1786401064.255419:0:14241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 44 00000100:00100000:2.0:1786401064.264264:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401064.264441:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850195712 00000100:00100000:3.0:1786401064.264452:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850195712 00000100:00100000:3.0:1786401064.264659:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 45 00000100:00100000:3.0:1786401064.264670:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+18:14464:x1873176850195712:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786401064.264692:0:14242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786401064.264719:0:14242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1eef7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6c05f expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.264758:0:14242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4400/0x5ccaaf4f3cb1eefe lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.264773:0:14242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4400/0x5ccaaf4f3cb1eefe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.264785:0:14242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4400/0x5ccaaf4f3cb1eefe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.264920:0:14242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1eef7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c05f expref: 20 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.265526:0:14242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4400/0x5ccaaf4f3cb1eefe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c05f expref: 19 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.265549:0:14242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d6fc5599800) 00010000:00010000:3.0:1786401064.265552:0:14242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1786401064.265555:0:14242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d70020e4400, rc 0) 00000100:00100000:3.0:1786401064.265620:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+19:14464:x1873176850195712:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 952us (1367us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401064.265628:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 45 00000100:00100000:0.0:1786401064.275595:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401064.275947:0:14902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850195968 00000100:00100000:3.0:1786401064.275962:0:14902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850195968 00000100:00100000:3.0:1786401064.276192:0:14902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 46 00000100:00100000:3.0:1786401064.276205:0:14902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cedfe83e-8f3e-46c2-8429-f823952ad440+19:14464:x1873176850195968:12345-192.168.204.8@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1786401064.276318:0:14902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5600/0x5ccaaf4f3cb1ef05 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.276337:0:14902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5600/0x5ccaaf4f3cb1ef05 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.276349:0:14902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5600/0x5ccaaf4f3cb1ef05 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1786401064.277132:0:14902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1786401064.277198:0:14902:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 516678110572ns, next at 517678106907ns, rc = 0 00000004:00010000:2.0:1786401064.277308:0:14902:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000088b85582 reply state 00000000335bcb41 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5600/0x5ccaaf4f3cb1ef05 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786401064.277335:0:14902:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1786401064.277456:0:14902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cedfe83e-8f3e-46c2-8429-f823952ad440+21:14464:x1873176850195968:12345-192.168.204.8@tcp:36:lhsmtool_posix.0 Request processed in 1252us (1869us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1786401064.277465:0:14902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 46 00010000:00010000:1.0:1786401064.282184:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5600/0x5ccaaf4f3cb1ef05 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.282203:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5600/0x5ccaaf4f3cb1ef05 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.282211:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5600/0x5ccaaf4f3cb1ef05 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.282217:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d70020e5600 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:1.0:1786401064.282223:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5600/0x5ccaaf4f3cb1ef05 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.282249:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5600/0x5ccaaf4f3cb1ef05 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.282269:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d6fc5599800) 00010000:00010000:1.0:1786401064.282273:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1786401064.282278:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5600/0x5ccaaf4f3cb1ef05 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.282285:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5600/0x5ccaaf4f3cb1ef05 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786401064.282705:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786401064.282890:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850196096 00000100:00100000:2.0:1786401064.282902:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850196096 00000100:00100000:2.0:1786401064.283180:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 47 00000100:00100000:2.0:1786401064.283193:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+20:14464:x1873176850196096:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1786401064.283223:0:14243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1786401064.283244:0:14243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c600/0x5ccaaf4f3cb1ef0c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6c066 expref: -99 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.283304:0:14243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c600/0x5ccaaf4f3cb1ef0c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c066 expref: 21 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.283317:0:14243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c600/0x5ccaaf4f3cb1ef0c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c066 expref: 21 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.283336:0:14243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d6fc5599800) 00010000:00010000:2.0:1786401064.283339:0:14243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786401064.283343:0:14243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc4e5c600, rc 0) 00000100:00100000:2.0:1786401064.283414:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+21:14464:x1873176850196096:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 223us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401064.283421:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 47 00000100:00100000:2.0:1786401064.291346:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401064.291730:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850196224 00000100:00100000:3.0:1786401064.291758:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850196224 00000100:00100000:3.0:1786401064.292080:0:14880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 12 00000100:00100000:3.0:1786401064.292127:0:14880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+5:2365:x1873176850196224:12345-192.168.204.8@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1786401064.292551:0:14880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+6:2365:x1873176850196224:12345-192.168.204.8@tcp:2:lhsmtool_posix.0 Request processed in 427us (1213us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1786401064.292560:0:14880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 12 00000100:00080000:1.0:1786401064.292877:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1786401064.300255:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786401064.300487:0:14245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850196480 00000100:00100000:1.0:1786401064.300498:0:14245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850196480 00000100:00100000:1.0:1786401064.300902:0:14245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 9 00000100:00100000:1.0:1786401064.300914:0:14245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdc9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+21:14464:x1873176850196480:12345-192.168.204.8@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1786401064.301875:0:14245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdc9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+22:14464:x1873176850196480:12345-192.168.204.8@tcp:35:lhsmtool_posix.0 Request processed in 959us (1628us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1786401064.301886:0:14245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 9 00000100:00100000:0.0:1786401064.313661:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786401064.313851:0:14241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850196736 00000100:00100000:2.0:1786401064.313871:0:14241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850196736 00000100:00100000:2.0:1786401064.315754:0:14241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 48 00000100:00100000:2.0:1786401064.315779:0:14241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fefd24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cedfe83e-8f3e-46c2-8429-f823952ad440+22:14464:x1873176850196736:12345-192.168.204.8@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1786401064.316677:0:14241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fefd24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cedfe83e-8f3e-46c2-8429-f823952ad440+22:14464:x1873176850196736:12345-192.168.204.8@tcp:57:lhsmtool_posix.0 Request processed in 902us (3030us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401064.316690:0:14241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 48 00000100:00100000:2.0:1786401064.324807:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401064.324948:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850196864 00000100:00100000:3.0:1786401064.324959:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850196864 00000100:00100000:3.0:1786401064.325019:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 49 00000100:00100000:3.0:1786401064.325029:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+22:14464:x1873176850196864:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786401064.325049:0:14242:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786401064.325069:0:14242:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1ef13 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6c06d expref: -99 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.325176:0:14242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5800/0x5ccaaf4f3cb1ef1a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.325190:0:14242:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5800/0x5ccaaf4f3cb1ef1a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.325202:0:14242:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5800/0x5ccaaf4f3cb1ef1a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1786401064.325244:0:14242:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1786401064.325264:0:14242:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5800/0x5ccaaf4f3cb1ef1a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14242 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.325290:0:14242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1ef13 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c06d expref: 24 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.325327:0:14242:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5800/0x5ccaaf4f3cb1ef1a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c06d expref: 23 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.325335:0:14242:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d6fc5599800) 00010000:00010000:3.0:1786401064.325338:0:14242:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1786401064.325342:0:14242:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d70020e5800, rc 0) 00000100:00100000:0.0:1786401064.325484:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+23:14464:x1873176850196864:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 454us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401064.325491:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 49 00000100:00100000:2.0:1786401064.333397:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401064.333498:0:14878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850196992 00000100:00100000:3.0:1786401064.333508:0:14878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850196992 00000100:00100000:3.0:1786401064.333584:0:14878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 13 00000100:00100000:3.0:1786401064.333594:0:14878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+6:2364:x1873176850196992:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1786401064.333614:0:14878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1786401064.333648:0:14878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000849ec7c3/0x5ccaaf4f3cb1ef21 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6c074 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1786401064.333677:0:14878:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a7a5127, blocks: 0x1 00010000:00010000:3.0:1786401064.333697:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1786401064.333702:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786401064.333712:0:14878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000849ec7c3/0x5ccaaf4f3cb1ef21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c074 expref: 7 pid: 14878 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.333732:0:14878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000849ec7c3/0x5ccaaf4f3cb1ef21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c074 expref: 7 pid: 14878 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.333745:0:14878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d70020e5600, rc 0) 00000100:00100000:3.0:1786401064.336393:0:14878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+7:2364:x1873176850196992:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 2788us (2994us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401064.336426:0:14878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 13 00000100:00100000:1.0:1786401064.361438:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786401064.361973:0:14902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850197248 00000100:00100000:2.0:1786401064.361986:0:14902:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850197248 00000100:00100000:2.0:1786401064.362145:0:14902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 50 00000100:00100000:2.0:1786401064.362157:0:14902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cedfe83e-8f3e-46c2-8429-f823952ad440+23:14464:x1873176850197248:12345-192.168.204.8@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1786401064.362279:0:14902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cedfe83e-8f3e-46c2-8429-f823952ad440+23:14464:x1873176850197248:12345-192.168.204.8@tcp:57:lhsmtool_posix.0 Request processed in 124us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401064.362287:0:14902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 50 00000100:00100000:2.0:1786401064.372779:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401064.372907:0:14242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850197376 00000100:00100000:0.0:1786401064.372916:0:14242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850197376 00000100:00100000:0.0:1786401064.373023:0:14242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 51 00000100:00100000:0.0:1786401064.373035:0:14242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff6ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+23:14464:x1873176850197376:12345-192.168.204.8@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1786401064.441980:0:14242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff6ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+23:14464:x1873176850197376:12345-192.168.204.8@tcp:44:lhsmtool_posix.0 Request processed in 68934us (69198us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401064.441993:0:14242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 51 00000001:00080000:2.0:1786401064.442256:0:5810:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:2.0:1786401064.442604:0:5810:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1786401064.442624:0:5810:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1786401064.443354:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1786401064.443374:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872196608:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1786401064.443434:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401064.443515:0:14877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872196608 00000100:00100000:1.0:1786401064.443538:0:14877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872196608 00000100:00100000:1.0:1786401064.443581:0:14877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1786401064.443591:0:14877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff692df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1873176872196608:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1786401064.443747:0:14877:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1786401064.443751:0:14877:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1786401064.443753:0:14877:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1786401064.443754:0:14877:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1786401063 -> 1786401063 00002000:00010000:1.0:1786401064.443757:0:14877:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1786401064.443791:0:14877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff692df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1873176872196608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 202us (356us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1786401064.443798:0:14877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:1.0:1786401064.443839:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d6ff692ca80/2, rc 0, transno 8589934595 00000100:00100000:1.0:1786401064.443844:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1873176872196608:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1786401064.449932:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401064.450892:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850197504 00000100:00100000:0.0:1786401064.450904:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850197504 00000100:00100000:1.0:1786401064.451651:0:14880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 15 00000100:00100000:1.0:1786401064.451665:0:14880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+7:2365:x1873176850197504:12345-192.168.204.8@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1786401064.451808:0:14880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+7:2365:x1873176850197504:12345-192.168.204.8@tcp:16:lhsmtool_posix.0 Request processed in 146us (1886us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401064.451816:0:14880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 15 00000100:00100000:0.0:1786401064.457746:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786401064.457946:0:14241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850197760 00000100:00100000:2.0:1786401064.457956:0:14241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850197760 00000100:00100000:2.0:1786401064.458025:0:14241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 52 00000100:00100000:2.0:1786401064.458035:0:14241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fefd27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cedfe83e-8f3e-46c2-8429-f823952ad440+14:14464:x1873176850197760:12345-192.168.204.8@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1786401064.458291:0:14241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1786401064.458319:0:14241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e5800/0x5ccaaf4f3cb1ef1a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c06d expref: 14 pid: 14242 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.458338:0:14241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d6fc5599800) 00010000:00010000:2.0:1786401064.458343:0:14241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1786401064.458602:0:14241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1ef28 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.458617:0:14241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1ef28 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.458627:0:14241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1ef28 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1786401064.458834:0:14241:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000071625d4e reply state 000000002f35ecd7 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1ef28 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786401064.458844:0:14241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1786401064.459823:0:14241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fefd27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cedfe83e-8f3e-46c2-8429-f823952ad440+15:14464:x1873176850197760:12345-192.168.204.8@tcp:36:lhsmtool_posix.0 Request processed in 1784us (2083us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1786401064.459832:0:14241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 52 00010000:00010000:2.0:1786401064.465067:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1ef28 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.465129:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1ef28 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.465139:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1ef28 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.465145:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d70020e4200 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786401064.465151:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1ef28 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.465159:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1ef28 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.465179:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d6fc5599800) 00010000:00010000:2.0:1786401064.465182:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786401064.465187:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1ef28 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.465193:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d70020e4200/0x5ccaaf4f3cb1ef28 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786401064.471993:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786401064.472732:0:14878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850197888 00000100:00100000:1.0:1786401064.472746:0:14878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850197888 00000100:00100000:1.0:1786401064.472837:0:14878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 16 00000100:00100000:1.0:1786401064.472847:0:14878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fefd26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+7:14464:x1873176850197888:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1786401064.472867:0:14878:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1786401064.472888:0:14878:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001253adbc/0x5ccaaf4f3cb1ef2f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8623b91e8ec6c07b expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.472937:0:14878:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000849ec7c3/0x5ccaaf4f3cb1ef21 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c074 expref: 8 pid: 14878 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.472946:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786401064.472950:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786401064.472956:0:14878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001253adbc/0x5ccaaf4f3cb1ef2f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c07b expref: 8 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.472987:0:14878:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000849ec7c3/0x5ccaaf4f3cb1ef21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c074 expref: 8 pid: 14878 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.473001:0:14878:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000849ec7c3/0x5ccaaf4f3cb1ef21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c074 expref: 8 pid: 14878 timeout: 616 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786401064.473016:0:14878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:14878:1873176872196736:192.168.204.8@tcp:104: 00000100:00100000:1.0:1786401064.473400:0:14878:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc4e43840 going to sleep for 11 seconds 00000100:00100000:1.0:1786401064.477582:0:14878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:14878:1873176872196736:192.168.204.8@tcp:104: 00010000:00010000:1.0:1786401064.477620:0:14878:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001253adbc/0x5ccaaf4f3cb1ef2f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c07b expref: 8 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.477653:0:14878:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc138ea00, rc 0) 00000100:00100000:1.0:1786401064.477719:0:14878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fefd26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+8:14464:x1873176850197888:12345-192.168.204.8@tcp:101:lhsmtool_posix.0 Request processed in 4873us (5734us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401064.477744:0:14878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 16 00000100:00100000:2.0:1786401064.483666:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401064.484213:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850198016 00000100:00100000:0.0:1786401064.484224:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850198016 00010000:00010000:0.0:1786401064.484269:0:14228:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000849ec7c3/0x5ccaaf4f3cb1ef21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c074 expref: 8 pid: 14878 timeout: 616 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786401064.484580:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 13 00000100:00100000:0.0:1786401064.484592:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fe9204000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+8:2362:x1873176850198016:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1786401064.484607:0:14228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1786401064.484630:0:14228:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000849ec7c3/0x5ccaaf4f3cb1ef21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c074 expref: 8 pid: 14878 timeout: 616 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401064.484656:0:14228:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000849ec7c3/0x5ccaaf4f3cb1ef21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c074 expref: 8 pid: 14878 timeout: 616 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401064.484697:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000849ec7c3/0x5ccaaf4f3cb1ef21 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c074 expref: 8 pid: 14878 timeout: 616 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401064.484716:0:14228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786401064.484720:0:14228:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786401064.484727:0:14228:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001253adbc/0x5ccaaf4f3cb1ef2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c07b expref: 7 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401064.484737:0:14228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001253adbc/0x5ccaaf4f3cb1ef2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c07b expref: 7 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401064.484777:0:14228:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001253adbc/0x5ccaaf4f3cb1ef2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c07b expref: 7 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786401064.484792:0:14228:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fefd24700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14228:1873176872196864:192.168.204.8@tcp:105: 00000100:00100000:0.0:1786401064.485740:0:14228:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc4e18300 going to sleep for 11 seconds 00000100:00100000:3.0:1786401064.493659:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1786401064.494047:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850198144 00000100:00100000:2.0:1786401064.494059:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850198144 00000100:00100000:2.0:1786401064.494148:0:14880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 17 00000100:00100000:2.0:1786401064.494159:0:14880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+8:2364:x1873176850198144:12345-192.168.204.8@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1786401064.494362:0:14880:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1786401064.494366:0:14880:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1786401062 00002000:00010000:2.0:1786401064.494383:0:14880:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1786401061 00002000:00010000:2.0:1786401064.494386:0:14880:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1786401063 -> 1786401062 00002000:00010000:2.0:1786401064.494388:0:14880:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1786401064.494452:0:14880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+9:2364:x1873176850198144:12345-192.168.204.8@tcp:2:lhsmtool_posix.0 Request processed in 293us (801us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1786401064.494461:0:14880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 17 00000100:00100000:1.0:1786401064.497281:0:14228:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fefd24700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14228:1873176872196864:192.168.204.8@tcp:105: 00010000:00010000:1.0:1786401064.497313:0:14228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1786401064.498137:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fe9204000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+8:2362:x1873176850198016:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 13542us (14476us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401064.498148:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 13 00000100:00100000:2.0:1786401064.502795:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786401064.502946:0:14878:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850198272 00000100:00100000:1.0:1786401064.502956:0:14878:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850198272 00000100:00100000:1.0:1786401064.503021:0:14878:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 18 00000100:00100000:1.0:1786401064.503031:0:14878:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fe9204e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+8:2363:x1873176850198272:12345-192.168.204.8@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1786401064.503102:0:14878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f9656702/0x5ccaaf4f3cb1ef36 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.503125:0:14878:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001253adbc/0x5ccaaf4f3cb1ef2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c07b expref: 8 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.503134:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786401064.503139:0:14878:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1786401064.503144:0:14878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9656702/0x5ccaaf4f3cb1ef36 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.503179:0:14878:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001253adbc/0x5ccaaf4f3cb1ef2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c07b expref: 8 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.503195:0:14878:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001253adbc/0x5ccaaf4f3cb1ef2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c07b expref: 8 pid: 14878 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786401064.503225:0:14878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:14878:1873176872196992:192.168.204.8@tcp:104: 00000100:00100000:1.0:1786401064.505824:0:14878:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc4e43840 going to sleep for 11 seconds 00000100:00100000:2.0:1786401064.514593:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786401064.515541:0:14878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:14878:1873176872196992:192.168.204.8@tcp:104: 00010000:00010000:1.0:1786401064.515573:0:14878:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f9656702/0x5ccaaf4f3cb1ef36 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786401064.515772:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850198400 00000100:00100000:3.0:1786401064.515782:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850198400 00010000:00010000:3.0:1786401064.515822:0:14226:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001253adbc/0x5ccaaf4f3cb1ef2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c07b expref: 9 pid: 14878 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786401064.515973:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14 00000100:00100000:3.0:1786401064.515984:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fe9204700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cedfe83e-8f3e-46c2-8429-f823952ad440+9:2364:x1873176850198400:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1786401064.516001:0:14226:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1786401064.516026:0:14226:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001253adbc/0x5ccaaf4f3cb1ef2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c07b expref: 9 pid: 14878 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.516052:0:14226:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001253adbc/0x5ccaaf4f3cb1ef2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c07b expref: 9 pid: 14878 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.516077:0:14226:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001253adbc/0x5ccaaf4f3cb1ef2f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c07b expref: 9 pid: 14878 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.516124:0:14226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786401064.516128:0:14226:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1786401064.516134:0:14226:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9656702/0x5ccaaf4f3cb1ef36 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.516144:0:14226:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9656702/0x5ccaaf4f3cb1ef36 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401064.516171:0:14226:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1786401064.516221:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fe9204700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cedfe83e-8f3e-46c2-8429-f823952ad440+8:2364:x1873176850198400:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 238us (1639us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401064.516227:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14 00010000:00010000:1.0:1786401064.517609:0:14878:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f9656702/0x5ccaaf4f3cb1ef36 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.517625:0:14878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9656702/0x5ccaaf4f3cb1ef36 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.517669:0:14878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f9656702/0x5ccaaf4f3cb1ef36 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.517678:0:14878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9656702/0x5ccaaf4f3cb1ef36 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.517685:0:14878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9656702/0x5ccaaf4f3cb1ef36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.517692:0:14878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1bbe00 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:1.0:1786401064.517697:0:14878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9656702/0x5ccaaf4f3cb1ef36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.517722:0:14878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9656702/0x5ccaaf4f3cb1ef36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.517738:0:14878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9656702/0x5ccaaf4f3cb1ef36 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.517745:0:14878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9656702/0x5ccaaf4f3cb1ef36 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786401064.517838:0:14878:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fe9204e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cedfe83e-8f3e-46c2-8429-f823952ad440+7:2363:x1873176850198272:12345-192.168.204.8@tcp:1:lhsmtool_posix.0 Request processed in 14804us (15049us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401064.517849:0:14878:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 18 00000100:00100000:2.0:1786401064.525692:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401064.525832:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850198656 00000100:00100000:0.0:1786401064.525843:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850198656 00000100:00100000:0.0:1786401064.525911:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 53 00000100:00100000:0.0:1786401064.525921:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fe9207480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+14:14464:x1873176850198656:12345-192.168.204.8@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1786401064.526008:0:14243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1ef3d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401064.526027:0:14243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1ef3d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401064.526053:0:14243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1ef3d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.532759:0:14243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1ef44 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.532789:0:14243:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c600/0x5ccaaf4f3cb1ef0c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c066 expref: 15 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.532799:0:14243:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1ef44 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.532840:0:14243:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c600/0x5ccaaf4f3cb1ef0c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c066 expref: 15 pid: 14243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.532857:0:14243:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c600/0x5ccaaf4f3cb1ef0c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c066 expref: 15 pid: 14243 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786401064.532885:0:14243:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14243:1873176872197120:192.168.204.8@tcp:104: 00000100:00100000:1.0:1786401064.532989:0:14243:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc4e43840 going to sleep for 11 seconds 00000100:00100000:0.0:1786401064.540325:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786401064.540355:0:14243:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14243:1873176872197120:192.168.204.8@tcp:104: 00010000:00010000:1.0:1786401064.540382:0:14243:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1ef44 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786401064.540663:0:16368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850198784 00000100:00100000:2.0:1786401064.540671:0:16368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850198784 00010000:00010000:2.0:1786401064.540708:0:16368:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c600/0x5ccaaf4f3cb1ef0c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c066 expref: 16 pid: 14243 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786401064.541219:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 15 00000100:00100000:1.0:1786401064.541232:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fefd26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+16:2365:x1873176850198784:12345-192.168.204.8@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1786401064.541248:0:14228:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1786401064.541256:0:14228:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c600/0x5ccaaf4f3cb1ef0c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c066 expref: 16 pid: 14243 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.541274:0:14228:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c600/0x5ccaaf4f3cb1ef0c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c066 expref: 16 pid: 14243 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.541297:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5c600/0x5ccaaf4f3cb1ef0c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c066 expref: 16 pid: 14243 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.541314:0:14228:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d6fc5599800) 00010000:00010000:1.0:1786401064.541319:0:14228:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1ef44 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.541328:0:14228:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1ef44 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.541336:0:14228:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1ef44 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.541441:0:14228:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1786401064.541586:0:14243:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1ef44 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.541594:0:14243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1ef44 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786401064.541741:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fefd26d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+15:2365:x1873176850198784:12345-192.168.204.8@tcp:103:ldlm_bl.0 Request processed in 511us (1424us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401064.541749:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 15 00000001:00080000:2.0:1786401064.541793:0:14243:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1786401064.541943:0:14243:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1786401064.541991:0:14243:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1786401064.544040:0:14243:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fe9206300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14243:1873176872197248:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1786401064.544260:0:14243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786401064.544334:0:14243:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fff87d840 going to sleep for 11 seconds 00000100:00100000:1.0:1786401064.544412:0:14246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872197248 00000100:00100000:1.0:1786401064.544421:0:14246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872197248 00000100:00100000:1.0:1786401064.544476:0:14246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1786401064.544486:0:14246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fe9207100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14243:x1873176872197248:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1786401064.544757:0:14246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fe9207100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14243:x1873176872197248:12345-0@lo:1000:mdt00_002.0 Request processed in 271us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401064.544765:0:14246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1786401064.544871:0:14243:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fe9206300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14243:1873176872197248:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1786401064.545955:0:14243:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1786401064.546040:0:14243:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fe9206300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14243:1873176872197376:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1786401064.546130:0:14243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786401064.546336:0:14243:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fff87dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1786401064.546661:0:14247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872197376 00000100:00100000:1.0:1786401064.546669:0:14247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872197376 00000100:00100000:1.0:1786401064.546757:0:14247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1786401064.546767:0:14247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fe9206680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14243:x1873176872197376:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1786401064.547019:0:14247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fe9206680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14243:x1873176872197376:12345-0@lo:1000:mdt00_002.0 Request processed in 253us (889us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1786401064.547027:0:14247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1786401064.547128:0:14243:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fe9206300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14243:1873176872197376:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1786401064.547173:0:14243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1ef44 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.547185:0:14243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1ef44 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.547194:0:14243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1ef44 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.547200:0:14243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1bbe00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786401064.547205:0:14243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1ef44 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.547213:0:14243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1ef44 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.547230:0:14243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d6fc5599800) 00010000:00010000:2.0:1786401064.547233:0:14243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786401064.547237:0:14243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1ef44 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.547244:0:14243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bbe00/0x5ccaaf4f3cb1ef44 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.547275:0:14243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1ee9c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.547282:0:14243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1ee9c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.547298:0:14243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1ee9c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.547304:0:14243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc138fa00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786401064.547307:0:14243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1ee9c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.547313:0:14243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1ee9c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.547322:0:14243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6fc90cd600) 00010000:00010000:2.0:1786401064.547324:0:14243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1786401064.547331:0:14243:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1eea3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c04a expref: 18 pid: 14241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.547343:0:14243:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1eea3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c04a expref: 18 pid: 14241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.547365:0:14243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1eea3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c04a expref: 18 pid: 14241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.547420:0:14243:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138f400/0x5ccaaf4f3cb1eea3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0x8623b91e8ec6c04a expref: 18 pid: 14241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786401064.547433:0:14243:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fe9206d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14243:1873176872197504:192.168.204.8@tcp:105: 00000100:00100000:2.0:1786401064.547494:0:14243:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fff87d900 going to sleep for 11 seconds 00000100:00100000:0.0:1786401064.554884:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786401064.554995:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850198912 00000100:00100000:1.0:1786401064.555005:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850198912 00000100:00100000:1.0:1786401064.555069:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 10 00000100:00100000:1.0:1786401064.555079:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fee1d4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cedfe83e-8f3e-46c2-8429-f823952ad440+19:14462:x1873176850198912:12345-192.168.204.8@tcp:49:dd.0 00000100:00100000:1.0:1786401064.555252:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fee1d4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cedfe83e-8f3e-46c2-8429-f823952ad440+19:14462:x1873176850198912:12345-192.168.204.8@tcp:49:dd.0 Request processed in 174us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401064.555262:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 10 00000100:00100000:2.0:1786401064.558566:0:14243:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fe9206d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14243:1873176872197504:192.168.204.8@tcp:105: 00010000:00010000:2.0:1786401064.558617:0:14243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1ee9c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.558629:0:14243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc138fa00/0x5ccaaf4f3cb1ee9c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.558680:0:14243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5dc00/0x5ccaaf4f3cb1ef4b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.558693:0:14243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5dc00/0x5ccaaf4f3cb1ef4b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.558705:0:14243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5dc00/0x5ccaaf4f3cb1ef4b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.558715:0:14243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5dc00/0x5ccaaf4f3cb1ef4b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.558721:0:14243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5dc00/0x5ccaaf4f3cb1ef4b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.558727:0:14243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5dc00/0x5ccaaf4f3cb1ef4b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.558734:0:14243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5dc00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786401064.558738:0:14243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5dc00/0x5ccaaf4f3cb1ef4b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.558745:0:14243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5dc00/0x5ccaaf4f3cb1ef4b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.558756:0:14243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6fc90cd600) 00010000:00010000:2.0:1786401064.558759:0:14243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1786401064.558770:0:14243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5dc00/0x5ccaaf4f3cb1ef4b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.558776:0:14243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc4e5dc00/0x5ccaaf4f3cb1ef4b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.558788:0:14243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1ef3d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.558794:0:14243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1ef3d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.558799:0:14243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1ef3d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.558805:0:14243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aae00 already unused, calling callback (ffffffffc21904f0) 00010000:00010000:2.0:1786401064.558807:0:14243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1ef3d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.558813:0:14243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1ef3d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.558821:0:14243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6fc90cd600) 00010000:00010000:2.0:1786401064.558823:0:14243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1786401064.558825:0:14243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1ef3d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.558830:0:14243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffd5aae00/0x5ccaaf4f3cb1ef3d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14243 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786401064.559161:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fe9207480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+18:14464:x1873176850198656:12345-192.168.204.8@tcp:57:lhsmtool_posix.0 Request processed in 33239us (33479us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1786401064.559172:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 53 00000020:00080000:2.0:1786401064.559184:0:14243:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1786401064.562229:0:14275:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1786401064.562240:0:14275:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1786401064.562270:0:14275:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1786401064.562275:0:14275:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1786401064.569469:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786401064.569581:0:14244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850199168 00000100:00100000:1.0:1786401064.569591:0:14244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850199168 00000100:00100000:1.0:1786401064.569693:0:14244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 11 00000100:00100000:1.0:1786401064.569703:0:14244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fefd24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cedfe83e-8f3e-46c2-8429-f823952ad440+18:14464:x1873176850199168:12345-192.168.204.8@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1786401064.570414:0:14244:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1786401064.570533:0:14244:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1786401064.570579:0:14244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1ef52 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.570597:0:14244:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1ef52 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.570610:0:14244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1ef52 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.570619:0:14244:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1ef52 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.570626:0:14244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1ef52 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.570645:0:14244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1ef52 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401064.570661:0:14244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1786401064.570769:0:14244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fefd24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cedfe83e-8f3e-46c2-8429-f823952ad440+20:14464:x1873176850199168:12345-192.168.204.8@tcp:35:lhsmtool_posix.0 Request processed in 1066us (1308us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1786401064.570789:0:14244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 11 00000020:00080000:1.0:1786401064.570794:0:14244:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1786401064.573902:0:15374:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1786401064.573917:0:15374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1ef52 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401064.573930:0:15374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1bba00 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:0.0:1786401064.573934:0:15374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1ef52 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401064.573945:0:15374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1ef52 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401064.573964:0:15374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d6fc5599800) 00010000:00010000:0.0:1786401064.573967:0:15374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1786401064.573971:0:15374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1ef52 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401064.573977:0:15374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fee1bba00/0x5ccaaf4f3cb1ef52 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14244 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401064.573998:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786401064.573999:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1786401064.574001:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401064.622862:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1786401064.687040:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fefd24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872197632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786401064.687528:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401064.687855:0:14882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872197632 00000100:00100000:0.0:1786401064.687865:0:14882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872197632 00000100:00100000:0.0:1786401064.687930:0:14882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1786401064.687940:0:14882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872197632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1786401064.687980:0:14882:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1786401064.688031:0:14882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1873176872197632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401064.688039:0:14882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1786401064.688257:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fefd24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1873176872197632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1786401064.752686:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401064.752735:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401064.752932:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401064.754162:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401064.755002:0:14884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850199424 00000100:00100000:0.0:1786401064.755016:0:14884:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850199424 00000100:00100000:2.0:1786401064.755213:0:14885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850199296 00000100:00100000:2.0:1786401064.755218:0:14885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850199296 00000100:00100000:2.0:1786401064.755243:0:14885:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850199552 00000100:00100000:2.0:1786401064.755246:0:14885:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850199552 00000100:00100000:2.0:1786401064.755265:0:14885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 0 00000100:00100000:2.0:1786401064.755274:0:14885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+9:2364:x1873176850199424:12345-192.168.204.8@tcp:4:dd.0 00002000:00010000:2.0:1786401064.755326:0:14885:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a7a5126, atime: 0x6a7a5125, ctime: 0x6a7a5126, blocks: 0x1 00010000:00010000:2.0:1786401064.755335:0:14885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091d16b46/0x5ccaaf4f3cb1ef59 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.755363:0:14885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=517s v=(0 0) 00010000:00010000:2.0:1786401064.755368:0:14885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786401064.755574:0:14885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091d16b46/0x5ccaaf4f3cb1ef59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.755593:0:14885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091d16b46/0x5ccaaf4f3cb1ef59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786401064.762175:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1786401064.762506:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401064.762937:0:14884:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1786401064.762996:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786401064.764042:0:14883:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1786401064.764095:0:14884:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1786401064.764861:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1786401064.764907:0:14883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850199680 00000100:00100000:1.0:1786401064.764915:0:14883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850199680 00000100:00100000:1.0:1786401064.764967:0:14883:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1786401064.764974:0:14883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850199808 00000100:00100000:1.0:1786401064.764977:0:14883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850199808 00000100:00100000:1.0:1786401064.764988:0:14883:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1786401064.764992:0:14883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850199936 00000100:00100000:1.0:1786401064.764995:0:14883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850199936 00000100:00100000:1.0:1786401064.765006:0:14883:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1786401064.765010:0:14883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850200064 00000100:00100000:1.0:1786401064.765012:0:14883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850200064 00000100:00100000:1.0:1786401064.765022:0:14883:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1786401064.765028:0:14883:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850200192 00000100:00100000:1.0:1786401064.765030:0:14883:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850200192 00000100:00100000:0.0:1786401064.766007:0:16371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1 00000100:00100000:0.0:1786401064.766022:0:16371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cedfe83e-8f3e-46c2-8429-f823952ad440+15:2364:x1873176850199296:12345-192.168.204.8@tcp:4:dd.0 00010000:00010000:0.0:1786401064.766063:0:16371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1a88f7b/0x5ccaaf4f3cb1ef60 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401064.766081:0:16371:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786401064.766131:0:16371:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786401064.766139:0:16371:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1a88f7b/0x5ccaaf4f3cb1ef60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401064.766155:0:16371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1a88f7b/0x5ccaaf4f3cb1ef60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786401064.901060:0:7501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:2.0:1786401064.901084:0:7501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:2.0:1786401064.902075:0:14885:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:2.0:1786401064.902082:0:14885:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1786401062 -> 1786401063 00002000:00010000:2.0:1786401064.902102:0:14885:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1786401062 -> 1786401063 00002000:00010000:2.0:1786401064.902105:0:14885:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:2.0:1786401064.902121:0:14885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091d16b46/0x5ccaaf4f3cb1ef59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.902154:0:14885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091d16b46/0x5ccaaf4f3cb1ef59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.902163:0:14885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091d16b46/0x5ccaaf4f3cb1ef59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.902170:0:14885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5c200 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:2.0:1786401064.902175:0:14885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091d16b46/0x5ccaaf4f3cb1ef59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.902184:0:14885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091d16b46/0x5ccaaf4f3cb1ef59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.902205:0:14885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091d16b46/0x5ccaaf4f3cb1ef59 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.902213:0:14885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091d16b46/0x5ccaaf4f3cb1ef59 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1786401064.902318:0:14885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+15:2364:x1873176850199424:12345-192.168.204.8@tcp:4:dd.0 Request processed in 147039us (149640us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1786401064.902329:0:14885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 0 00000100:00100000:2.0:1786401064.902380:0:14885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2 00000100:00100000:2.0:1786401064.902394:0:14885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+14:2365:x1873176850199552:12345-192.168.204.8@tcp:4:dd.0 00010000:00010000:2.0:1786401064.902429:0:14885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9d2f91a/0x5ccaaf4f3cb1ef67 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.902449:0:14885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786401064.902453:0:14885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1786401064.902459:0:14885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9d2f91a/0x5ccaaf4f3cb1ef67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1786401064.902470:0:14885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9d2f91a/0x5ccaaf4f3cb1ef67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786401064.965179:0:7501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:0.0:1786401064.965462:0:16371:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:0.0:1786401064.965468:0:16371:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2055 -> 4103 00010000:00010000:0.0:1786401064.965641:0:16371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1a88f7b/0x5ccaaf4f3cb1ef60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401064.966707:0:16371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1a88f7b/0x5ccaaf4f3cb1ef60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401064.966717:0:16371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1a88f7b/0x5ccaaf4f3cb1ef60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401064.966724:0:16371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5ab600 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:0.0:1786401064.966729:0:16371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1a88f7b/0x5ccaaf4f3cb1ef60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401064.966738:0:16371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1a88f7b/0x5ccaaf4f3cb1ef60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401064.966760:0:16371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1a88f7b/0x5ccaaf4f3cb1ef60 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401064.966767:0:16371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1a88f7b/0x5ccaaf4f3cb1ef60 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786401064.967835:0:16371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cedfe83e-8f3e-46c2-8429-f823952ad440+14:2364:x1873176850199296:12345-192.168.204.8@tcp:4:dd.0 Request processed in 201809us (215091us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1786401064.967847:0:16371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1 00000100:00100000:0.0:1786401064.967882:0:16371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 3 00000100:00100000:0.0:1786401064.967895:0:16371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cedfe83e-8f3e-46c2-8429-f823952ad440+13:2365:x1873176850199680:12345-192.168.204.8@tcp:4:dd.0 00010000:00010000:0.0:1786401064.967932:0:16371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b86e4734/0x5ccaaf4f3cb1ef6e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401064.967954:0:16371:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786401064.967958:0:16371:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786401064.967964:0:16371:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b86e4734/0x5ccaaf4f3cb1ef6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401064.967977:0:16371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b86e4734/0x5ccaaf4f3cb1ef6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786401065.005465:0:7501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:1.0:1786401065.005786:0:14885:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:1.0:1786401065.005792:0:14885:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:1.0:1786401065.005808:0:14885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9d2f91a/0x5ccaaf4f3cb1ef67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401065.005823:0:14885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9d2f91a/0x5ccaaf4f3cb1ef67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401065.005833:0:14885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9d2f91a/0x5ccaaf4f3cb1ef67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401065.005841:0:14885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc4e5d600 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:1.0:1786401065.005847:0:14885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9d2f91a/0x5ccaaf4f3cb1ef67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401065.005871:0:14885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9d2f91a/0x5ccaaf4f3cb1ef67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401065.005894:0:14885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9d2f91a/0x5ccaaf4f3cb1ef67 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401065.005902:0:14885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9d2f91a/0x5ccaaf4f3cb1ef67 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1786401065.005996:0:14885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+13:2365:x1873176850199552:12345-192.168.204.8@tcp:4:dd.0 Request processed in 103602us (253058us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1786401065.006005:0:14885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2 00000100:00100000:1.0:1786401065.006038:0:14885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4 00000100:00100000:1.0:1786401065.006050:0:14885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc97f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+12:2365:x1873176850199808:12345-192.168.204.8@tcp:4:dd.0 00010000:00010000:1.0:1786401065.006080:0:14885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b022b692/0x5ccaaf4f3cb1ef75 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401065.006128:0:14885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786401065.006133:0:14885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1786401065.006139:0:14885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b022b692/0x5ccaaf4f3cb1ef75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1786401065.006153:0:14885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b022b692/0x5ccaaf4f3cb1ef75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1786401065.059492:0:7501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:0.0:1786401065.060315:0:16371:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:0.0:1786401065.060323:0:16371:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:0.0:1786401065.060341:0:16371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b86e4734/0x5ccaaf4f3cb1ef6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401065.060367:0:16371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b86e4734/0x5ccaaf4f3cb1ef6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401065.060377:0:16371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b86e4734/0x5ccaaf4f3cb1ef6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401065.060386:0:16371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aba00 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:0.0:1786401065.060391:0:16371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b86e4734/0x5ccaaf4f3cb1ef6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401065.060400:0:16371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b86e4734/0x5ccaaf4f3cb1ef6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401065.060441:0:16371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b86e4734/0x5ccaaf4f3cb1ef6e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401065.060448:0:16371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b86e4734/0x5ccaaf4f3cb1ef6e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786401065.060758:0:16371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cedfe83e-8f3e-46c2-8429-f823952ad440+12:2365:x1873176850199680:12345-192.168.204.8@tcp:4:dd.0 Request processed in 92862us (306595us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1786401065.060769:0:16371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 3 00000100:00100000:0.0:1786401065.060806:0:16371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 5 00000100:00100000:0.0:1786401065.060821:0:16371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4984380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cedfe83e-8f3e-46c2-8429-f823952ad440+11:2364:x1873176850199936:12345-192.168.204.8@tcp:4:dd.0 00010000:00010000:0.0:1786401065.060858:0:16371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000caadea99/0x5ccaaf4f3cb1ef7c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401065.060871:0:16371:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786401065.060875:0:16371:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786401065.060882:0:16371:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000caadea99/0x5ccaaf4f3cb1ef7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401065.060893:0:16371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000caadea99/0x5ccaaf4f3cb1ef7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786401065.116985:0:7501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:0.0:1786401065.117192:0:14885:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:0.0:1786401065.117198:0:14885:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:0.0:1786401065.117212:0:14885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b022b692/0x5ccaaf4f3cb1ef75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401065.117238:0:14885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b022b692/0x5ccaaf4f3cb1ef75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401065.117247:0:14885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b022b692/0x5ccaaf4f3cb1ef75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401065.117254:0:14885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fee1baa00 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:0.0:1786401065.117259:0:14885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b022b692/0x5ccaaf4f3cb1ef75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401065.117268:0:14885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b022b692/0x5ccaaf4f3cb1ef75 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401065.117459:0:14885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b022b692/0x5ccaaf4f3cb1ef75 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401065.117468:0:14885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b022b692/0x5ccaaf4f3cb1ef75 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786401065.117718:0:14885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc97f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+11:2365:x1873176850199808:12345-192.168.204.8@tcp:4:dd.0 Request processed in 111666us (355548us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1786401065.117728:0:14885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4 00000100:00100000:0.0:1786401065.117757:0:14885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 6 00000100:00100000:0.0:1786401065.117768:0:14885:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4985180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+10:2365:x1873176850200064:12345-192.168.204.8@tcp:4:dd.0 00010000:00010000:0.0:1786401065.117798:0:14885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b86e4734/0x5ccaaf4f3cb1ef83 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401065.117814:0:14885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786401065.117818:0:14885:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1786401065.117825:0:14885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b86e4734/0x5ccaaf4f3cb1ef83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401065.117836:0:14885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b86e4734/0x5ccaaf4f3cb1ef83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1786401065.198315:0:7501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:3.0:1786401065.205354:0:16371:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:3.0:1786401065.205367:0:16371:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 14343 00010000:00010000:3.0:1786401065.205382:0:16371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000caadea99/0x5ccaaf4f3cb1ef7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401065.205395:0:16371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000caadea99/0x5ccaaf4f3cb1ef7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401065.205404:0:16371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000caadea99/0x5ccaaf4f3cb1ef7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401065.205411:0:16371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5ab800 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:3.0:1786401065.205416:0:16371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000caadea99/0x5ccaaf4f3cb1ef7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401065.205426:0:16371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000caadea99/0x5ccaaf4f3cb1ef7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401065.205447:0:16371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000caadea99/0x5ccaaf4f3cb1ef7c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401065.205455:0:16371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000caadea99/0x5ccaaf4f3cb1ef7c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1786401065.206294:0:16371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4984380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cedfe83e-8f3e-46c2-8429-f823952ad440+10:2364:x1873176850199936:12345-192.168.204.8@tcp:4:dd.0 Request processed in 145473us (443782us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1786401065.206312:0:16371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 5 00000100:00100000:3.0:1786401065.206358:0:16371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 7 00000100:00100000:3.0:1786401065.206371:0:16371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4985c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cedfe83e-8f3e-46c2-8429-f823952ad440+9:2365:x1873176850200192:12345-192.168.204.8@tcp:4:dd.0 00010000:00010000:3.0:1786401065.206406:0:16371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000849ec7c3/0x5ccaaf4f3cb1ef8a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401065.206421:0:16371:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786401065.206425:0:16371:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1786401065.206432:0:16371:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000849ec7c3/0x5ccaaf4f3cb1ef8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1786401065.206444:0:16371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000849ec7c3/0x5ccaaf4f3cb1ef8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1786401065.296226:0:14885:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00010000:00010000:0.0:1786401065.296251:0:14885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b86e4734/0x5ccaaf4f3cb1ef83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401065.296265:0:14885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b86e4734/0x5ccaaf4f3cb1ef83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401065.296275:0:14885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b86e4734/0x5ccaaf4f3cb1ef83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401065.296283:0:14885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffd5aba00 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:0.0:1786401065.296288:0:14885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b86e4734/0x5ccaaf4f3cb1ef83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401065.296298:0:14885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b86e4734/0x5ccaaf4f3cb1ef83 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401065.296320:0:14885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b86e4734/0x5ccaaf4f3cb1ef83 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401065.296355:0:14885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b86e4734/0x5ccaaf4f3cb1ef83 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786401065.296448:0:14885:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4985180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+11:2365:x1873176850200064:12345-192.168.204.8@tcp:4:dd.0 Request processed in 178678us (533447us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1786401065.296457:0:14885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 6 00000001:00080000:0.0:1786401065.296492:0:7501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00000001:00080000:1.0:1786401065.355556:0:7501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00002000:00010000:0.0:1786401065.355894:0:16371:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:0.0:1786401065.355912:0:16371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000849ec7c3/0x5ccaaf4f3cb1ef8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401065.355926:0:16371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000849ec7c3/0x5ccaaf4f3cb1ef8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401065.355936:0:16371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000849ec7c3/0x5ccaaf4f3cb1ef8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401065.355944:0:16371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d70020e5600 already unused, calling callback (ffffffffc1754e90) 00010000:00010000:0.0:1786401065.355949:0:16371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000849ec7c3/0x5ccaaf4f3cb1ef8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401065.355958:0:16371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000849ec7c3/0x5ccaaf4f3cb1ef8a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401065.355979:0:16371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000849ec7c3/0x5ccaaf4f3cb1ef8a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1786401065.355998:0:16371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000849ec7c3/0x5ccaaf4f3cb1ef8a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1786401065.356179:0:16371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4985c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:cedfe83e-8f3e-46c2-8429-f823952ad440+5:2365:x1873176850200192:12345-192.168.204.8@tcp:4:dd.0 Request processed in 149807us (591315us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1786401065.356190:0:16371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 7 00010000:00010000:2.0:1786401065.646322:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786401066.033587:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401066.033737:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401066.033775:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401066.033806:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401066.033828:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401066.033846:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401066.033863:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1786401066.033899:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850200576 00000100:00100000:0.0:1786401066.033907:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850200576 00000100:00100000:0.0:1786401066.033954:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850201088 00000100:00100000:0.0:1786401066.033958:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850201088 00000100:00100000:0.0:1786401066.033973:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850200704 00000100:00100000:0.0:1786401066.033976:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850200704 00000100:00100000:0.0:1786401066.033989:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850200960 00000100:00100000:0.0:1786401066.033991:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850200960 00000100:00100000:0.0:1786401066.034008:0:14880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 18 00000100:00100000:0.0:1786401066.034017:0:14880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fefd24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+5:2365:x1873176850200576:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786401066.034220:0:14880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fefd24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+5:2365:x1873176850200576:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 203us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401066.034229:0:14880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 18 00000100:00100000:0.0:1786401066.034262:0:14880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 19 00000100:00100000:0.0:1786401066.034371:0:14880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9366b5e6-e19b-4a08-b543-2a32b0307b57+5:2365:x1873176850201088:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786401066.034405:0:14880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9366b5e6-e19b-4a08-b543-2a32b0307b57+5:2365:x1873176850201088:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 136us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401066.034411:0:14880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 19 00000100:00100000:0.0:1786401066.034423:0:14880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 20 00000100:00100000:0.0:1786401066.034429:0:14880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+5:2365:x1873176850200704:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786401066.034452:0:14880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cedfe83e-8f3e-46c2-8429-f823952ad440+5:2365:x1873176850200704:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 24us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401066.034458:0:14880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 20 00000100:00100000:0.0:1786401066.034469:0:14880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 21 00000100:00100000:0.0:1786401066.034475:0:14880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9366b5e6-e19b-4a08-b543-2a32b0307b57+5:2365:x1873176850200960:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786401066.034499:0:14880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9366b5e6-e19b-4a08-b543-2a32b0307b57+5:2365:x1873176850200960:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 24us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401066.034505:0:14880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 21 00000100:00100000:0.0:1786401066.035455:0:14241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850200832 00000100:00100000:0.0:1786401066.035464:0:14241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850200832 00000100:00100000:0.0:1786401066.035507:0:14241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850200448 00000100:00100000:0.0:1786401066.035521:0:14241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850200448 00000100:00100000:0.0:1786401066.035548:0:14241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 29 00000100:00100000:0.0:1786401066.035556:0:14241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9366b5e6-e19b-4a08-b543-2a32b0307b57+6:2365:x1873176850200832:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786401066.035638:0:14241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9366b5e6-e19b-4a08-b543-2a32b0307b57+6:2365:x1873176850200832:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 82us (1861us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401066.035645:0:14241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 29 00000100:00100000:0.0:1786401066.035659:0:14241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 30 00000100:00100000:0.0:1786401066.035672:0:14241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cedfe83e-8f3e-46c2-8429-f823952ad440+20:2365:x1873176850200448:12345-192.168.204.8@tcp:400:kworker.0 00000100:00100000:0.0:1786401066.035699:0:14241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cedfe83e-8f3e-46c2-8429-f823952ad440+20:2365:x1873176850200448:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 28us (1870us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401066.035705:0:14241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 30 00000100:00100000:3.0:1786401066.036762:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176850200320 00000100:00100000:3.0:1786401066.036772:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176850200320 00000100:00100000:3.0:1786401066.036916:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 122 00000100:00100000:3.0:1786401066.036926:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a470e8d0-b507-45e2-885f-f3cf1de83cf7+13:2365:x1873176850200320:12345-192.168.204.8@tcp:400:kworker.0 00000100:00080000:1.0:1786401066.036930:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1786401066.036935:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1786401066.036938:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1786401066.037191:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a470e8d0-b507-45e2-885f-f3cf1de83cf7+13:2365:x1873176850200320:12345-192.168.204.8@tcp:400:kworker.0 Request processed in 266us (3613us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401066.037199:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 122 00010000:00010000:0.0:1786401066.670218:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1786401067.367776:0:16409:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1786401067.694417:0:14229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1786401068.719122:0:14230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1786401069.295037:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff692f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872197760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1786401069.295129:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1786401069.295621:0:14882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872197760 00000100:00100000:1.0:1786401069.295754:0:14882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872197760 00000100:00100000:1.0:1786401069.295825:0:14882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1786401069.295837:0:14882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffd571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872197760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1786401069.295878:0:14882:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1786401069.295933:0:14882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffd571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1873176872197760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1786401069.295940:0:14882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1786401069.295978:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1786401069.295983:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d6ff692ca80, transno 8589934595 00000004:00080000:1.0:1786401069.296357:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1786401069.296384:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff692f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1873176872197760:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1786401069.298428:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1786401069.298661:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc4985f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:054a13af-ec40-49d6-93c2-21045d196afe:3306:1873176872197888:0@lo:400:kworker.0 00000100:00100000:1.0:1786401069.298733:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1786401069.298852:0:14235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872197888 00000100:00100000:0.0:1786401069.298860:0:14235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872197888 00000100:00100000:0.0:1786401069.298907:0:14235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1786401069.298916:0:14235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffdbe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+19:3306:x1873176872197888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786401069.302371:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc4986a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872198016:0@lo:400:kworker.0 00000100:00100000:3.0:1786401069.302440:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786401069.302474:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1786401069.302481:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc4985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1873176872198400:0@lo:400:kworker.0 00000100:00100000:3.0:1786401069.302505:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1786401069.302537:0:14880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872198016 00000100:00100000:3.0:1786401069.304597:0:14880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872198016 00000100:00100000:3.0:1786401069.304688:0:14880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1786401069.304699:0:14880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4986d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872198016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786401069.304780:0:14880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4986d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1873176872198016:12345-0@lo:400:kworker.0 Request processed in 84us (2340us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401069.304788:0:14880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1786401069.304814:0:14241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872198400 00000100:00100000:3.0:1786401069.304818:0:14241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872198400 00000100:00100000:3.0:1786401069.304846:0:14241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1786401069.304853:0:14241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc4985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1873176872198400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1786401069.304885:0:14241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc4985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1873176872198400:12345-0@lo:400:kworker.0 Request processed in 33us (2379us total) trans 0 rc 0/0 00000100:00100000:3.0:1786401069.304891:0:14241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1786401069.304931:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc4985880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1873176872198400:0@lo:400:kworker.0 00000100:00100000:3.0:1786401069.304942:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc4986a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1873176872198016:0@lo:400:kworker.0 00000100:00080000:3.0:1786401069.304966:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1786401069.304971:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1786401069.305078:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc4987100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873176872198144:0@lo:400:kworker.0 00000100:00100000:2.0:1786401069.305131:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786401069.305156:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1786401069.305162:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc4984700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873176872198272:0@lo:400:kworker.0 00000100:00100000:2.0:1786401069.305186:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1786401069.305211:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872198144 00000100:00100000:2.0:1786401069.305215:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872198144 00000100:00100000:2.0:1786401069.305237:0:14243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873176872198272 00000100:00100000:2.0:1786401069.305240:0:14243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1873176872198272 00000100:00100000:2.0:1786401069.305272:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1786401069.305279:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fe9206d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873176872198144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786401069.305314:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fe9206d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1873176872198144:12345-0@lo:400:kworker.0 Request processed in 35us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401069.305333:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1786401069.305349:0:14243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1786401069.305355:0:14243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fe9204380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873176872198272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1786401069.305384:0:14243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fe9204380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1873176872198272:12345-0@lo:400:kworker.0 Request processed in 30us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1786401069.305390:0:14243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1786401069.305416:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc4984700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1873176872198272:0@lo:400:kworker.0 00000100:00100000:2.0:1786401069.305425:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc4987100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1873176872198144:0@lo:400:kworker.0 00000100:00080000:3.0:1786401069.305556:0:14237:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1786401069.305627:0:14235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffdbe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:054a13af-ec40-49d6-93c2-21045d196afe+19:3306:x1873176872197888:12345-0@lo:400:kworker.0 Request processed in 6711us (6892us total) trans 0 rc 0/0 00000100:00100000:0.0:1786401069.305637:0:14235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1786401069.306414:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc4985f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:054a13af-ec40-49d6-93c2-21045d196afe:3306:1873176872197888:0@lo:400:kworker.0 00010000:00010000:1.0:1786401069.745391:0:15374:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29265 lines, 29265 kept, 0 dropped, 0 bad.